[ 520.116490] env[65292]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 520.116490] env[65292]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 521.092764] env[65381]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.092764] env[65381]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.665515] env[65381]: INFO neutron.common.config [-] Logging enabled! [ 522.665885] env[65381]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev9 [ 522.666072] env[65381]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65381) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 522.666382] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 522.666504] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 522.667358] env[65381]: WARNING oslo_policy.policy [None req-818a8435-3c9a-4704-904f-447835ab737c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 522.667575] env[65381]: WARNING oslo_policy.policy [None req-818a8435-3c9a-4704-904f-447835ab737c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 522.669366] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-818a8435-3c9a-4704-904f-447835ab737c None None] VMware NSXv3 Agent initialized successfully. [ 522.669760] env[65381]: DEBUG oslo_concurrency.lockutils [None req-818a8435-3c9a-4704-904f-447835ab737c None None] Acquiring lock "singleton_lock" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.669895] env[65381]: DEBUG oslo_concurrency.lockutils [None req-818a8435-3c9a-4704-904f-447835ab737c None None] Acquired lock "singleton_lock" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.670114] env[65381]: DEBUG oslo_concurrency.lockutils [None req-818a8435-3c9a-4704-904f-447835ab737c None None] Releasing lock "singleton_lock" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 522.670406] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] Full set of CONF: {{(pid=65381) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 522.670519] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ******************************************************************************** {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 522.670621] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] Configuration options gathered from: {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 522.670989] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 522.671208] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 522.671318] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ================================================================================ {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 522.671489] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] agent_down_time = 75 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.671625] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] allow_automatic_dhcp_failover = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.671758] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] allow_bulk = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.671899] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] api_extensions_path = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672046] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] api_paste_config = api-paste.ini {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672187] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] auth_strategy = keystone {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672291] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] backdoor_port = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672392] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] backdoor_socket = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672550] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] backlog = 4096 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672695] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] base_mac = fa:16:3e:00:00:00 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672851] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] bind_host = 0.0.0.0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.672988] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] bind_port = 9696 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673157] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] client_socket_timeout = 900 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673298] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] config_dir = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673406] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673541] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] config_source = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673676] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] control_exchange = neutron {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673813] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] core_plugin = ml2 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.673978] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] debug = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.674133] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] default_availability_zones = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.674339] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.674476] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] dhcp_agent_notification = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.674609] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] dhcp_agents_per_network = 1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.674738] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] dhcp_lease_duration = 86400 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.674875] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] dhcp_load_type = networks {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675024] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] dns_domain = openstacklocal {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675159] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675325] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_default_route_bfd = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675468] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_default_route_ecmp = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675605] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_dvr = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675735] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_new_agents = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675866] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.675996] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_signals = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.676141] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] enable_traditional_dhcp = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.676272] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] external_dns_driver = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.676402] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] filter_validation = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.676544] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] global_physnet_mtu = 8950 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.676681] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] graceful_shutdown_timeout = 60 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.676899] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] host = cpu-1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677067] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] host_dvr_for_dhcp = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677206] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] http_retries = 3 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677351] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] instance_format = [instance: %(uuid)s] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677486] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677623] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ipam_driver = internal {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677754] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ipv6_pd_enabled = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.677884] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] l3_ha = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678030] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678168] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] l3_ha_network_physical_name = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678309] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] l3_ha_network_type = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678472] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_color = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678612] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_config_append = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678752] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.678883] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_dir = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679028] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_file = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679130] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_options = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679277] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_rotate_interval = 1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679420] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_rotate_interval_type = days {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679558] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] log_rotation_type = none {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679662] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679764] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.679926] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680083] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680189] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680326] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] max_dns_nameservers = 5 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680457] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] max_header_line = 16384 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680584] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] max_l3_agents_per_router = 3 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680712] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] max_logfile_count = 30 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680840] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] max_logfile_size_mb = 200 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.680965] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] max_subnet_host_routes = 20 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681114] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] my_ip = 10.180.1.21 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681260] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] my_ipv6 = ::1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681426] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] network_auto_schedule = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681561] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] network_link_prefix = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681702] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681839] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] notify_nova_on_port_data_changes = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.681975] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] notify_nova_on_port_status_changes = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682123] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] pagination_max_limit = -1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682254] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] publish_errors = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682384] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] rate_limit_burst = 0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682521] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] rate_limit_except_level = CRITICAL {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682657] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] rate_limit_interval = 0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682825] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] retry_until_window = 30 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.682971] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] router_distributed = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683117] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] rpc_resources_processing_step = 20 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683249] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] rpc_response_max_timeout = 600 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683382] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] rpc_response_timeout = 60 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683511] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] send_events_interval = 2 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683658] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] service_plugins = ['router'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683795] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] setproctitle = on {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.683920] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] shell_completion = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684067] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] state_path = /opt/stack/data/neutron {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684234] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] syslog_log_facility = LOG_USER {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684374] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] tcp_keepidle = 600 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684510] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] transport_url = **** {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684643] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] use_journal = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684772] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] use_json = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.684899] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] use_ssl = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685036] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] use_stderr = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685175] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] use_syslog = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685302] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] vlan_qinq = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685426] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] vlan_transparent = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685551] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] watch_log_file = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685688] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] wsgi_default_pool_size = 100 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685815] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] wsgi_keep_alive = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.685951] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.686091] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] wsgi_server_debug = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 522.686244] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_concurrency.disable_process_locking = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.686392] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.686534] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.686669] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.686807] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.686948] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687134] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687292] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.connection_string = messaging:// {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687433] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.enabled = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687570] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.es_doc_type = notification {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687702] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.es_scroll_size = 10000 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687835] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.es_scroll_time = 2m {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.687964] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.filter_error_trace = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688109] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.hmac_keys = **** {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688245] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.sentinel_service_name = mymaster {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688394] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.socket_timeout = 0.1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688565] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.trace_requests = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688706] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler.trace_sqlalchemy = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688852] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler_jaeger.process_tags = {} {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.688986] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler_jaeger.service_name_prefix = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.689137] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] profiler_otlp.service_name_prefix = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.689290] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.enforce_new_defaults = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.689565] env[65381]: WARNING oslo_config.cfg [None req-818a8435-3c9a-4704-904f-447835ab737c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 522.689717] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.enforce_scope = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.689889] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.policy_default_rule = default {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690051] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690206] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690351] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690485] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690616] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690745] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.690877] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691023] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_policy.remote_timeout = 60.0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691177] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691331] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] agent.extensions = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691474] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691614] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] service_providers.service_provider = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691757] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.default_quota = -1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.691895] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692037] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_floatingip = 50 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692169] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_network = 100 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692300] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_port = 500 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692428] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692556] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_router = 10 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692715] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_security_group = 10 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692861] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.692991] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.quota_subnet = 100 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693139] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] QUOTAS.track_quota_usage = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693288] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693422] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.group = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693551] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.helper_command = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693683] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.log_daemon_traceback = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693819] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.693949] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.thread_pool_size = 8 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694119] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep.user = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694312] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694452] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.group = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694586] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.helper_command = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694718] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694852] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.694983] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695126] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_dhcp_release.user = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695268] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695399] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.group = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695527] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.helper_command = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695693] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695839] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.695972] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696113] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_ovs_vsctl.user = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696251] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.capabilities = [21] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696379] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.group = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696509] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.helper_command = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696640] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.log_daemon_traceback = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696774] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.696905] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.thread_pool_size = 8 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697068] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_namespace.user = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697212] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.capabilities = [12] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697342] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.group = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697471] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.helper_command = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697603] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697738] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697871] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.697997] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_conntrack.user = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698154] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.capabilities = [12, 21] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698277] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.group = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698405] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.helper_command = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698564] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.log_daemon_traceback = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698713] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698845] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.thread_pool_size = 8 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.698971] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] privsep_link.user = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699139] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699303] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699447] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.continue_on_failed_promotions = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699582] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.dscp = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699721] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.dscp_inherit = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699862] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.force_mp_to_policy = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.699997] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.locking_coordinator_url = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.700154] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.log_agent_heartbeats = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.700310] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.logging_expire = 1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.700453] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.700587] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.700730] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.polling_interval = 240 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.700866] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701017] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701169] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.report_interval = 30.0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701310] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701447] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701586] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701723] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.sync_skew = 60 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701857] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.synchronization_queue_size = 20 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.701990] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT.use_helper_for_ns_read = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702146] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] SECURITYGROUP.enable_ipset = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702287] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] SECURITYGROUP.enable_security_group = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702425] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702564] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702701] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] experimental.ipv6_pd_enabled = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702853] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.extension_drivers = ['port_security'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.702984] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.external_network_type = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703146] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703286] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.overlay_ip_version = 4 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703424] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.path_mtu = 8950 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703560] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.physical_network_mtus = {} {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703705] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.tenant_network_types = ['vlan'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703840] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.703977] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ml2.type_drivers = ['vlan'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704133] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT_CLI.neutron_port_id = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704266] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704399] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704540] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704680] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704816] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.704952] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705103] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705241] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705445] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705586] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_login_password = **** {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705724] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_login_port = 443 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705859] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_login_user = admin {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.705994] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706146] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706280] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706417] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706551] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706691] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706827] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.706959] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707104] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707239] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707380] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707511] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707646] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707832] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.707973] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] vsphere.vsphere_login_password = VMware1! {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708124] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708259] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708395] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.auth_section = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708534] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.auth_type = password {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708667] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708794] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.certfile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.708924] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.collect_timing = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709072] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.endpoint_type = public {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709242] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.insecure = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709387] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.keyfile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709528] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.region_name = RegionOne {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709658] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.split_loggers = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709783] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] nova.timeout = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.709915] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.auth_section = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710065] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.auth_type = password {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710227] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710366] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.certfile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710497] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.collect_timing = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710636] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.endpoint_type = public {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710762] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.insecure = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.710884] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.keyfile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711028] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.region_name = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711147] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.split_loggers = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711273] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] placement.timeout = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711406] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.auth_section = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711537] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.auth_type = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711661] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.cafile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711783] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.certfile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.711911] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.collect_timing = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712048] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.connect_retries = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712176] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.connect_retry_delay = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712327] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.enable_notifications = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712462] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.endpoint_override = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712591] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.insecure = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712715] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.interface = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712838] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.keyfile = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.712966] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.max_version = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713100] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.min_version = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713226] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.region_name = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713349] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.retriable_status_codes = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713472] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.service_name = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713595] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.service_type = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713718] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.split_loggers = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713840] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.status_code_retries = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.713962] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.status_code_retry_delay = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714095] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.timeout = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714219] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.valid_interfaces = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714343] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ironic.version = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714472] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] cli_script.dry_run = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714610] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714740] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714869] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.714998] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715140] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715276] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715428] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715563] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715694] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715833] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.715962] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716111] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716250] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716387] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716519] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716654] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716782] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.716912] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717062] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717195] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717324] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717450] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717577] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717710] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717838] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.717964] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718101] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718233] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718383] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718521] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718653] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.ssl = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718791] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.718926] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719067] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719227] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719377] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.ssl_version = {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719509] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719650] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_notifications.driver = [] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719784] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_notifications.retry = -1 {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.719928] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.720066] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] oslo_messaging_notifications.transport_url = **** {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 522.720193] env[65381]: DEBUG oslo_service.backend._eventlet.service [None req-818a8435-3c9a-4704-904f-447835ab737c None None] ******************************************************************************** {{(pid=65381) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 522.721323] env[65381]: DEBUG neutron.agent.securitygroups_rpc [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Init firewall settings (driver=nsxv3) {{(pid=65381) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 522.722618] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65381) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 522.722857] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] RPC agent_id: nsxm-l-01a.corp.local [ 522.725105] env[65381]: DEBUG dogpile.cache.region [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 522.725228] env[65381]: DEBUG dogpile.lock [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 522.725330] env[65381]: DEBUG dogpile.lock [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 522.725421] env[65381]: DEBUG dogpile.lock [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 522.725514] env[65381]: DEBUG dogpile.cache.region [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 522.725601] env[65381]: DEBUG dogpile.lock [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 522.725723] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 522.770404] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Session token - acquiring [ 522.772030] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.772255] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.772331] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.772743] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.785051] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.070071] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 523.092180] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 523.092394] env[65381]: DEBUG dogpile.cache.region [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Cache value generated in 0.367 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 523.092503] env[65381]: DEBUG dogpile.lock [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 523.092587] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Activating Policy API Provider. [ 523.092784] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Looking for the default Infrastructure Rules. [ 523.158894] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Looking for the Default Layer3 Logged Drop Section. [ 523.173820] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 523.174298] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.174469] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.174568] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.174845] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 523.175183] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.689982] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.192919] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.695174] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Inventory metadata is going to be refreshed. [ 524.695567] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 525.462117] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.462362] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.462362] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.462764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.474847] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 525.475749] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.476341] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 525.496745] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.496967] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.497051] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.497381] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.497512] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.497661] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 525.497775] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.497878] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 525.517759] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.518040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.518040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.518346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.518521] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.518664] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 525.540780] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.540992] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.541047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.541320] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.541461] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.541755] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 525.560969] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.561213] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.561259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.561635] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.561777] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.561922] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 525.562033] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.562139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 525.582579] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.582830] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.582876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.583198] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.583329] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.583478] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 525.583578] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.583679] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 525.603201] env[65381]: DEBUG networking_nsxv3.common.locking [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.603470] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.603563] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.603857] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.603997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.604163] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 525.604361] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 525.604483] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Inventory metadata have been refreshed. [ 525.604579] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Dryrun:True. Metadata refresh completed. [ 525.604696] env[65381]: DEBUG oslo_concurrency.lockutils [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Releasing lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 525.606449] env[65381]: INFO neutron.agent.agent_extensions_manager [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Loaded agent extensions: [] [ 525.607231] env[65381]: DEBUG neutron_lib.callbacks.manager [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65381) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 525.656852] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent RPC Daemon Started! [ 525.657020] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:0 started [ 525.657075] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent out of sync with plugin! [ 530.608354] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 530.608750] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 535.609888] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.610297] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.720854] env[65381]: INFO networking_nsxv3.common.synchronization [None req-70c998b4-8aa3-452a-a5b3-7e6803d93e79 demo admin] Enqueued Resource ID: d1458316-0ec4-44c4-8cce-42ecae32b7cc with Priority: HIGHEST for action security_group_rules [ 538.721084] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1458316-0ec4-44c4-8cce-42ecae32b7cc with Priority: HIGHEST for action security_group_rules [ 538.721273] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1458316-0ec4-44c4-8cce-42ecae32b7cc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.721399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1458316-0ec4-44c4-8cce-42ecae32b7cc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.721487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1458316-0ec4-44c4-8cce-42ecae32b7cc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.721798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1458316-0ec4-44c4-8cce-42ecae32b7cc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.721882] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1458316-0ec4-44c4-8cce-42ecae32b7cc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.241717] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.241963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.241963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.242155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.242253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.242348] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1458316-0ec4-44c4-8cce-42ecae32b7cc already deleted. [ 539.242430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1458316-0ec4-44c4-8cce-42ecae32b7cc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.721612] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.722338] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.723698] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.723698] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.724537] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.724999] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.726483] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.726935] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.727420] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.727683] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.111238] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a00a6d53-9131-48c7-80b5-4cdfaf93dee7 None None] Enqueued Resource ID: 4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96 with Priority: HIGHEST for action port [ 566.111497] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96 with Priority: HIGHEST for action port [ 566.112347] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.112347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.112347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.112547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.112547] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.615856] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96 [ 566.616103] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.616297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.616369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.616576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.616667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.616774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96 already deleted. [ 566.616856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf9e65d-3e3a-40cc-8ab0-5cbc2bfa2b96" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.316018] env[65381]: INFO networking_nsxv3.common.synchronization [None req-8c1f681b-f944-4c52-a41c-f5d9bbbdb567 None None] Enqueued Resource ID: 7bf5912f-cd2e-4200-b3e2-ca27b79b738e with Priority: HIGHEST for action port [ 568.316324] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5912f-cd2e-4200-b3e2-ca27b79b738e with Priority: HIGHEST for action port [ 568.316838] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bf5912f-cd2e-4200-b3e2-ca27b79b738e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.317139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bf5912f-cd2e-4200-b3e2-ca27b79b738e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.317139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bf5912f-cd2e-4200-b3e2-ca27b79b738e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.317341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bf5912f-cd2e-4200-b3e2-ca27b79b738e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.317405] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bf5912f-cd2e-4200-b3e2-ca27b79b738e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.568568] env[65381]: INFO networking_nsxv3.common.synchronization [None req-40dd7375-49d2-4754-a660-472b0afc7f49 None None] Enqueued Resource ID: e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9 with Priority: HIGHEST for action port [ 568.571178] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9 with Priority: HIGHEST for action port [ 568.571178] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.571178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.571178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.571420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.571420] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.822143] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bf5912f-cd2e-4200-b3e2-ca27b79b738e [ 568.822143] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.822143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.822143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.822143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.822143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.822143] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bf5912f-cd2e-4200-b3e2-ca27b79b738e already deleted. [ 568.822143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bf5912f-cd2e-4200-b3e2-ca27b79b738e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.073924] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9 [ 569.074155] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.074815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.074815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.074815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.074815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.074815] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9 already deleted. [ 569.075144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7bb8c3b-7f9f-403f-94c8-9b2d572fb9a9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.196718] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1aef83ac-1b3a-4cbf-b1a9-b61fff5d1b65 None None] Enqueued Resource ID: 9b4b35be-a184-430e-9e7f-82befbc7594a with Priority: HIGHEST for action port [ 570.197097] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4b35be-a184-430e-9e7f-82befbc7594a with Priority: HIGHEST for action port [ 570.197383] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b4b35be-a184-430e-9e7f-82befbc7594a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.197655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b4b35be-a184-430e-9e7f-82befbc7594a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.197655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b4b35be-a184-430e-9e7f-82befbc7594a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.197792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b4b35be-a184-430e-9e7f-82befbc7594a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.197871] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b4b35be-a184-430e-9e7f-82befbc7594a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.613933] env[65381]: INFO networking_nsxv3.common.synchronization [None req-d49c6d16-8a83-44fb-8d9a-94ff7df4af59 None None] Enqueued Resource ID: 66f0f033-72ac-49d2-a730-4779dc612249 with Priority: HIGHEST for action port [ 570.614805] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f0f033-72ac-49d2-a730-4779dc612249 with Priority: HIGHEST for action port [ 570.614889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-66f0f033-72ac-49d2-a730-4779dc612249 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.615032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66f0f033-72ac-49d2-a730-4779dc612249" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.615091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66f0f033-72ac-49d2-a730-4779dc612249" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.615339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66f0f033-72ac-49d2-a730-4779dc612249" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.615432] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66f0f033-72ac-49d2-a730-4779dc612249',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.704528] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b4b35be-a184-430e-9e7f-82befbc7594a [ 570.704753] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.704889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.704959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.705190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.705281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.705377] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b4b35be-a184-430e-9e7f-82befbc7594a already deleted. [ 570.705461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b4b35be-a184-430e-9e7f-82befbc7594a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.119940] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66f0f033-72ac-49d2-a730-4779dc612249 [ 571.120259] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.120419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.120486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.120722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.120811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.120918] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66f0f033-72ac-49d2-a730-4779dc612249 already deleted. [ 571.121024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66f0f033-72ac-49d2-a730-4779dc612249" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.498178] env[65381]: INFO networking_nsxv3.common.synchronization [None req-8b7bc5e6-f0ed-41e4-b6b3-9fd5aafa061e None None] Enqueued Resource ID: 912bdd59-6150-4965-b271-ce18c6f07973 with Priority: HIGHEST for action port [ 572.499346] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912bdd59-6150-4965-b271-ce18c6f07973 with Priority: HIGHEST for action port [ 572.499346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-912bdd59-6150-4965-b271-ce18c6f07973 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.499346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912bdd59-6150-4965-b271-ce18c6f07973" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.500303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912bdd59-6150-4965-b271-ce18c6f07973" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.500303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912bdd59-6150-4965-b271-ce18c6f07973" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.500303] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912bdd59-6150-4965-b271-ce18c6f07973',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.002697] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 912bdd59-6150-4965-b271-ce18c6f07973 [ 573.002697] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.002697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.002697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.002697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.002697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.002697] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:912bdd59-6150-4965-b271-ce18c6f07973 already deleted. [ 573.002697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912bdd59-6150-4965-b271-ce18c6f07973" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.317507] env[65381]: INFO networking_nsxv3.common.synchronization [None req-8f3e8c10-1f5e-40e9-a606-75ca233ba1d9 None None] Enqueued Resource ID: f251d9dc-97cc-4d26-b1a1-570e7553e49e with Priority: HIGHEST for action port [ 573.317507] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f251d9dc-97cc-4d26-b1a1-570e7553e49e with Priority: HIGHEST for action port [ 573.317507] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f251d9dc-97cc-4d26-b1a1-570e7553e49e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.317507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f251d9dc-97cc-4d26-b1a1-570e7553e49e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.317507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f251d9dc-97cc-4d26-b1a1-570e7553e49e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.317507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f251d9dc-97cc-4d26-b1a1-570e7553e49e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.317507] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f251d9dc-97cc-4d26-b1a1-570e7553e49e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.819014] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f251d9dc-97cc-4d26-b1a1-570e7553e49e [ 573.822149] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.822149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.822149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.822149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.822149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.822149] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f251d9dc-97cc-4d26-b1a1-570e7553e49e already deleted. [ 573.822149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f251d9dc-97cc-4d26-b1a1-570e7553e49e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.012168] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b19b54c0-a7ab-4bae-9360-6b45aae9be78 None None] Enqueued Resource ID: 90016fdb-5345-4a5e-839e-ddc449133cfa with Priority: HIGHEST for action port [ 575.012168] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90016fdb-5345-4a5e-839e-ddc449133cfa with Priority: HIGHEST for action port [ 575.015241] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-90016fdb-5345-4a5e-839e-ddc449133cfa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.015523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90016fdb-5345-4a5e-839e-ddc449133cfa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.015667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90016fdb-5345-4a5e-839e-ddc449133cfa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.016075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90016fdb-5345-4a5e-839e-ddc449133cfa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.016238] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90016fdb-5345-4a5e-839e-ddc449133cfa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.520767] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90016fdb-5345-4a5e-839e-ddc449133cfa [ 575.520908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.521338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.521338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.521436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.523019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.523019] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90016fdb-5345-4a5e-839e-ddc449133cfa already deleted. [ 575.523019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90016fdb-5345-4a5e-839e-ddc449133cfa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.267146] env[65381]: INFO networking_nsxv3.common.synchronization [None req-13624944-db7e-4abd-a97f-b8248c466071 None None] Enqueued Resource ID: 7c9b3249-b2e1-4031-a0cf-c17739e9aaa1 with Priority: HIGHEST for action port [ 576.267146] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c9b3249-b2e1-4031-a0cf-c17739e9aaa1 with Priority: HIGHEST for action port [ 576.267146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c9b3249-b2e1-4031-a0cf-c17739e9aaa1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.267146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c9b3249-b2e1-4031-a0cf-c17739e9aaa1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.267146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c9b3249-b2e1-4031-a0cf-c17739e9aaa1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.267146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c9b3249-b2e1-4031-a0cf-c17739e9aaa1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.267146] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c9b3249-b2e1-4031-a0cf-c17739e9aaa1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.770252] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c9b3249-b2e1-4031-a0cf-c17739e9aaa1 [ 576.770500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.770640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.770880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.770946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.771115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.771115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c9b3249-b2e1-4031-a0cf-c17739e9aaa1 already deleted. [ 576.771248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c9b3249-b2e1-4031-a0cf-c17739e9aaa1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.560046] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b0b4ce6c-8738-4c41-a617-d4756277bc1a None None] Enqueued Resource ID: a79826ad-3c49-4d32-aee6-9dd899985786 with Priority: HIGHEST for action port [ 578.560959] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79826ad-3c49-4d32-aee6-9dd899985786 with Priority: HIGHEST for action port [ 578.561082] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79826ad-3c49-4d32-aee6-9dd899985786 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.561294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79826ad-3c49-4d32-aee6-9dd899985786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.561294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79826ad-3c49-4d32-aee6-9dd899985786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.562535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79826ad-3c49-4d32-aee6-9dd899985786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.562535] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79826ad-3c49-4d32-aee6-9dd899985786',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.762090] env[65381]: INFO networking_nsxv3.common.synchronization [None req-2e673006-5e00-439e-80fd-d2583cf7d189 None None] Enqueued Resource ID: 3e51321c-513f-42e9-b06d-8098e2ebe961 with Priority: HIGHEST for action port [ 578.762090] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e51321c-513f-42e9-b06d-8098e2ebe961 with Priority: HIGHEST for action port [ 578.762090] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e51321c-513f-42e9-b06d-8098e2ebe961 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.762090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e51321c-513f-42e9-b06d-8098e2ebe961" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.762090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e51321c-513f-42e9-b06d-8098e2ebe961" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.762090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e51321c-513f-42e9-b06d-8098e2ebe961" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.762090] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e51321c-513f-42e9-b06d-8098e2ebe961',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.065202] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a79826ad-3c49-4d32-aee6-9dd899985786 [ 579.065202] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.065202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.065202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.065202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.065202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.065202] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a79826ad-3c49-4d32-aee6-9dd899985786 already deleted. [ 579.065202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79826ad-3c49-4d32-aee6-9dd899985786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.149632] env[65381]: INFO networking_nsxv3.common.synchronization [None req-f6007e95-9730-45b4-b090-73cce84f3391 None None] Enqueued Resource ID: ca7fd612-3e0c-41c3-a871-9dbc3b755b15 with Priority: HIGHEST for action port [ 579.149632] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7fd612-3e0c-41c3-a871-9dbc3b755b15 with Priority: HIGHEST for action port [ 579.152311] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca7fd612-3e0c-41c3-a871-9dbc3b755b15 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.152311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca7fd612-3e0c-41c3-a871-9dbc3b755b15" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.154947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca7fd612-3e0c-41c3-a871-9dbc3b755b15" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.154947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca7fd612-3e0c-41c3-a871-9dbc3b755b15" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.154947] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7fd612-3e0c-41c3-a871-9dbc3b755b15',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.265325] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e51321c-513f-42e9-b06d-8098e2ebe961 [ 579.265620] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.265732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.265795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.265963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.266064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.266157] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e51321c-513f-42e9-b06d-8098e2ebe961 already deleted. [ 579.266289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e51321c-513f-42e9-b06d-8098e2ebe961" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.658080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca7fd612-3e0c-41c3-a871-9dbc3b755b15 [ 579.658592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.658736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.659439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.659439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.659439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.659439] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca7fd612-3e0c-41c3-a871-9dbc3b755b15 already deleted. [ 579.659439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca7fd612-3e0c-41c3-a871-9dbc3b755b15" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.325065] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6a9bb51e-a691-477b-a366-63dab5033dc7 None None] Enqueued Resource ID: 0a0233be-7512-48bf-a834-c735193f4aef with Priority: HIGHEST for action port [ 582.326452] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0233be-7512-48bf-a834-c735193f4aef with Priority: HIGHEST for action port [ 582.326530] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a0233be-7512-48bf-a834-c735193f4aef taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.326630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a0233be-7512-48bf-a834-c735193f4aef" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.326792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a0233be-7512-48bf-a834-c735193f4aef" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.326947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a0233be-7512-48bf-a834-c735193f4aef" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.327040] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0233be-7512-48bf-a834-c735193f4aef',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.647673] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6269bdb7-a73b-485d-9343-3a742c43b706 None None] Enqueued Resource ID: 34ddd4c2-b34f-402a-948e-3e718ce53d38 with Priority: HIGHEST for action port [ 582.648234] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ddd4c2-b34f-402a-948e-3e718ce53d38 with Priority: HIGHEST for action port [ 582.648576] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ddd4c2-b34f-402a-948e-3e718ce53d38 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.648752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ddd4c2-b34f-402a-948e-3e718ce53d38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.648865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ddd4c2-b34f-402a-948e-3e718ce53d38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.649238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ddd4c2-b34f-402a-948e-3e718ce53d38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.649372] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ddd4c2-b34f-402a-948e-3e718ce53d38',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.829604] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a0233be-7512-48bf-a834-c735193f4aef [ 582.829818] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.829921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.829921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.830335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.830335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.830401] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a0233be-7512-48bf-a834-c735193f4aef already deleted. [ 582.830630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a0233be-7512-48bf-a834-c735193f4aef" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.884481] env[65381]: INFO networking_nsxv3.common.synchronization [None req-cf655f7b-0d13-459d-9766-734fbc80b974 None None] Enqueued Resource ID: 1ff47b89-173e-4831-aece-5d41c7bbcf32 with Priority: HIGHEST for action port [ 582.884481] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff47b89-173e-4831-aece-5d41c7bbcf32 with Priority: HIGHEST for action port [ 582.884481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff47b89-173e-4831-aece-5d41c7bbcf32 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.884481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff47b89-173e-4831-aece-5d41c7bbcf32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.884481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff47b89-173e-4831-aece-5d41c7bbcf32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.887207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff47b89-173e-4831-aece-5d41c7bbcf32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.887207] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff47b89-173e-4831-aece-5d41c7bbcf32',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.936543] env[65381]: INFO networking_nsxv3.common.synchronization [None req-60320dae-651e-4240-b7d5-4398439a3cd2 None None] Enqueued Resource ID: 5f48b915-9ee1-4ed0-9844-39cd76f24561 with Priority: HIGHEST for action port [ 582.937076] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f48b915-9ee1-4ed0-9844-39cd76f24561 with Priority: HIGHEST for action port [ 582.937620] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f48b915-9ee1-4ed0-9844-39cd76f24561 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.939990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f48b915-9ee1-4ed0-9844-39cd76f24561" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.940372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f48b915-9ee1-4ed0-9844-39cd76f24561" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.940420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f48b915-9ee1-4ed0-9844-39cd76f24561" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.940478] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f48b915-9ee1-4ed0-9844-39cd76f24561',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.153652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34ddd4c2-b34f-402a-948e-3e718ce53d38 [ 583.154219] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.154219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.154219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.154219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.154571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.154571] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34ddd4c2-b34f-402a-948e-3e718ce53d38 already deleted. [ 583.154571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ddd4c2-b34f-402a-948e-3e718ce53d38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.388251] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ff47b89-173e-4831-aece-5d41c7bbcf32 [ 583.388499] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.388616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.388681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.388896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.388977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.391525] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ff47b89-173e-4831-aece-5d41c7bbcf32 already deleted. [ 583.391525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff47b89-173e-4831-aece-5d41c7bbcf32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.443329] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f48b915-9ee1-4ed0-9844-39cd76f24561 [ 583.443595] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.443703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.443774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.445566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.445707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.446105] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f48b915-9ee1-4ed0-9844-39cd76f24561 already deleted. [ 583.446237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f48b915-9ee1-4ed0-9844-39cd76f24561" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.609668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.609828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.609900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.610113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.611627] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.115784] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.620620] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.714688] env[65381]: INFO networking_nsxv3.common.synchronization [None req-fd19099a-b0cb-45be-9821-da45b9dabca4 tempest-VolumesAssistedSnapshotsTest-911230567 tempest-VolumesAssistedSnapshotsTest-911230567-project-member] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_rules [ 584.717767] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_rules [ 584.718985] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.718985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.719166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.719795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.719885] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.936695] env[65381]: INFO networking_nsxv3.common.synchronization [None req-47209175-29df-4528-af57-25cbaf9ff7da tempest-VolumesAssistedSnapshotsTest-911230567 tempest-VolumesAssistedSnapshotsTest-911230567-project-member] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_rules [ 584.936944] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_rules [ 584.937970] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.937970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.032081] env[65381]: INFO networking_nsxv3.common.synchronization [req-181a05b5-6945-46f2-a2c9-8369785fe0c4 req-b250a166-d70b-4456-8ccd-8a3d861d528a tempest-DeleteServersAdminTestJSON-2008928171 tempest-DeleteServersAdminTestJSON-2008928171-project-member] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 585.032081] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 585.032081] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.032081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.032081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.032081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.033699] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.033836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.033907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.034124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.034216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.034325] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.124786] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 585.124970] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 585.253883] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.253883] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c2d48d-c321-4e23-999d-809958401c70 already deleted. [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.253883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.253883] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.538214] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.538214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.538214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.538388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.538423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.539527] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.539527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.539527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.539527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.539527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.539527] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 already deleted. [ 585.539527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.783650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.783650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.783650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.783650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.783650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.783650] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c2d48d-c321-4e23-999d-809958401c70 already deleted. [ 585.783650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.020077] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.020353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.020353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.020786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.032617] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 586.032897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.035039] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 586.057034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.057034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.057034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.057034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.057034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.057034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 586.057034] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.057034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 586.077340] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.077535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.077535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.077778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.077875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.077987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.101721] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.101964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.101964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.102359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.102574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.102719] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.127763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.127886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.127886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.128092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.128259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.128326] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 586.128375] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.128424] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 586.147416] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.147593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.147665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.147839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.147929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.148076] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 586.148212] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.148212] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 586.170315] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.170733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.170733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.170733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.171142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.171142] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 586.171142] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.171142] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 586.171142] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 586.171308] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 586.171374] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 586.171407] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 586.172296] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 586.172383] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 586.172460] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.197211] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.197211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.197211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.197211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.197211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.197211] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.217590] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.217590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.217590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.218847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.218847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.237531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.499712] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5936aaed-74ce-4943-aa83-9e14f4ad746b tempest-ServersTestFqdnHostnames-1355028209 tempest-ServersTestFqdnHostnames-1355028209-project-member] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_rules [ 586.500488] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_rules [ 586.501131] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.501131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.501131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.501337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.501371] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.718095] env[65381]: INFO networking_nsxv3.common.synchronization [None req-86fe9d1c-14e8-46c8-8719-a82b1198839a None None] Enqueued Resource ID: 95a58bbf-adc9-4d84-89df-7bd9af93c22a with Priority: HIGHEST for action port [ 586.718629] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95a58bbf-adc9-4d84-89df-7bd9af93c22a with Priority: HIGHEST for action port [ 586.718925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-95a58bbf-adc9-4d84-89df-7bd9af93c22a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.719184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95a58bbf-adc9-4d84-89df-7bd9af93c22a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.719184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95a58bbf-adc9-4d84-89df-7bd9af93c22a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.720250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95a58bbf-adc9-4d84-89df-7bd9af93c22a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.720522] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95a58bbf-adc9-4d84-89df-7bd9af93c22a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.044288] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.044288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.044288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.044288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.044288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.044288] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 already deleted. [ 587.044288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.067863] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.068067] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.068200] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.068714] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.068868] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.069013] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.070223] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.070539] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.070713] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.071035] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.071187] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.071335] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.071476] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.071652] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.071785] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.071944] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.081250] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e33c6a88-0e0a-446c-8bf9-d94eb3586825 None None] Enqueued Resource ID: 31ad61f3-6f3c-4441-9905-49467b28cdfc with Priority: HIGHEST for action port [ 587.081409] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ad61f3-6f3c-4441-9905-49467b28cdfc with Priority: HIGHEST for action port [ 587.081837] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-31ad61f3-6f3c-4441-9905-49467b28cdfc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.081983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31ad61f3-6f3c-4441-9905-49467b28cdfc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.082083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31ad61f3-6f3c-4441-9905-49467b28cdfc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.082431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31ad61f3-6f3c-4441-9905-49467b28cdfc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.082511] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31ad61f3-6f3c-4441-9905-49467b28cdfc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.090902] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.091567] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.091720] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.092406] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.092739] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-64818f99-2eac-4709-b12f-53910bd5883d taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.092911] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.093064] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.093384] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.093521] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64818f99-2eac-4709-b12f-53910bd5883d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.203983] env[65381]: INFO networking_nsxv3.common.synchronization [None req-35925d78-a52f-4522-beed-c6b3949fd3f7 tempest-ServersTestFqdnHostnames-1355028209 tempest-ServersTestFqdnHostnames-1355028209-project-member] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_rules [ 587.204686] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_rules [ 587.204991] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.205128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.205188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.205387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.205466] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.223019] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95a58bbf-adc9-4d84-89df-7bd9af93c22a [ 587.223245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.223364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.223427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.223639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.223732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.223798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95a58bbf-adc9-4d84-89df-7bd9af93c22a already deleted. [ 587.223915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95a58bbf-adc9-4d84-89df-7bd9af93c22a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.588022] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31ad61f3-6f3c-4441-9905-49467b28cdfc [ 587.588022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.588022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.588022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.588022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.588022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.588022] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31ad61f3-6f3c-4441-9905-49467b28cdfc already deleted. [ 587.588022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31ad61f3-6f3c-4441-9905-49467b28cdfc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.599979] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.600596] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.600763] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.601050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.601199] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.601414] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 64818f99-2eac-4709-b12f-53910bd5883d not found, creating... [ 587.601696] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.601861] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.601976] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.602214] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.602354] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.602761] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.603287] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.603444] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.603732] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.603945] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.604170] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 64818f99-2eac-4709-b12f-53910bd5883d is going to be created. [ 587.627892] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.627892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.627892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.627892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.627892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.627892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.728243] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.728243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.728359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.728519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.728608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.728759] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 already deleted. [ 587.728865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.388650] env[65381]: INFO networking_nsxv3.common.synchronization [req-181a05b5-6945-46f2-a2c9-8369785fe0c4 req-f92c0fb0-e820-4ece-a546-062b844b25f2 service nova] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_rules [ 588.388650] env[65381]: INFO networking_nsxv3.common.synchronization [req-181a05b5-6945-46f2-a2c9-8369785fe0c4 req-f92c0fb0-e820-4ece-a546-062b844b25f2 service nova] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 588.389012] env[65381]: INFO networking_nsxv3.common.synchronization [req-181a05b5-6945-46f2-a2c9-8369785fe0c4 req-f92c0fb0-e820-4ece-a546-062b844b25f2 service nova] Enqueued Resource ID: 64818f99-2eac-4709-b12f-53910bd5883d with Priority: HIGHEST for action port [ 588.389357] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_rules [ 588.389489] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 588.389593] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64818f99-2eac-4709-b12f-53910bd5883d with Priority: HIGHEST for action port [ 588.389865] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.389987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.390180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.390589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.390697] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.392289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.392289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.392289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.392510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.392707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.395532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.395532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.395532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.395532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.395532] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.395886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-64818f99-2eac-4709-b12f-53910bd5883d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.396063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.396173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.396532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.396570] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64818f99-2eac-4709-b12f-53910bd5883d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.899089] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.899229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.907706] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.908650] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64818f99-2eac-4709-b12f-53910bd5883d with status ACTIVE [ 588.908853] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.908978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.909053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.909255] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.909345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.911616] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.911616] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.911616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.911616] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64818f99-2eac-4709-b12f-53910bd5883d is going to be updated. [ 588.933022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.933201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.933273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.933479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.933820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.933982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64818f99-2eac-4709-b12f-53910bd5883d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.165214] env[65381]: INFO networking_nsxv3.common.synchronization [req-04e344f3-799c-480f-ba26-bdd4499e3231 req-8e13a707-d80e-4294-9868-7c1dab80ca00 tempest-ServerDiagnosticsNegativeTest-1221916531 tempest-ServerDiagnosticsNegativeTest-1221916531-project-member] Enqueued Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_members [ 589.165214] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_members [ 589.165214] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.165214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.165214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.165214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.165214] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.165214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.165214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.166050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.166339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.166612] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.412376] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.671499] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.671684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.671735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.671930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.672180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.672180] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.672366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.672415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.672581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.672651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.672740] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2380b72e-771a-447f-bf96-4a7738880121 already deleted. [ 589.672817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.805761] env[65381]: INFO networking_nsxv3.common.synchronization [None req-bec42394-663b-4227-a52a-27e820fa3252 None None] Enqueued Resource ID: dbd8ea6a-4334-4e52-a530-a10985f9d53f with Priority: HIGHEST for action port [ 589.806882] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbd8ea6a-4334-4e52-a530-a10985f9d53f with Priority: HIGHEST for action port [ 589.806882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbd8ea6a-4334-4e52-a530-a10985f9d53f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.806882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbd8ea6a-4334-4e52-a530-a10985f9d53f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.806882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbd8ea6a-4334-4e52-a530-a10985f9d53f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.811092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbd8ea6a-4334-4e52-a530-a10985f9d53f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.811278] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbd8ea6a-4334-4e52-a530-a10985f9d53f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.907980] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.908273] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.908468] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.908830] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.909225] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.909503] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.909564] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.910605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.910605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.910605] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.910605] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.910605] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.910782] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.910904] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.911060] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.911240] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.914802] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.915050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.915050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.915281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.915394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.915807] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be created. [ 589.934483] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.934661] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.934851] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.934995] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.935260] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-7ac86539-e16b-47ed-b083-746ea8f9d5a5 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.935425] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.935578] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.935863] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.935993] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac86539-e16b-47ed-b083-746ea8f9d5a5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.946322] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.946475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.946545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.946735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.946892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.956791] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: UNINITIALIZED for 2s [ 590.313486] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbd8ea6a-4334-4e52-a530-a10985f9d53f [ 590.313486] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.313697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.313697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.313908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.313997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.317180] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbd8ea6a-4334-4e52-a530-a10985f9d53f already deleted. [ 590.317296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbd8ea6a-4334-4e52-a530-a10985f9d53f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.439028] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.439028] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.439494] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.439801] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.439967] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.440145] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 7ac86539-e16b-47ed-b083-746ea8f9d5a5 not found, creating... [ 590.440470] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.440629] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.440741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.440973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.441135] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.441455] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.441655] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.441733] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.441941] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.443713] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.443713] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 7ac86539-e16b-47ed-b083-746ea8f9d5a5 is going to be created. [ 590.466441] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.466602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.466707] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.466971] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.467217] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.467435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.867060] env[65381]: INFO networking_nsxv3.common.synchronization [req-7f327626-e28f-453a-aeac-c319d1d9675a req-eb2ac4d6-3c14-4c7b-9832-5e05a6d965fa tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 590.867525] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 590.867823] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.867945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.868637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.868942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.869124] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.869236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.869302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.869458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.869542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.869634] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.199249] env[65381]: INFO networking_nsxv3.common.synchronization [req-04e344f3-799c-480f-ba26-bdd4499e3231 req-d1688b4a-5455-413d-a717-1e8fbf250fe0 service nova] Enqueued Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_rules [ 591.199416] env[65381]: INFO networking_nsxv3.common.synchronization [req-04e344f3-799c-480f-ba26-bdd4499e3231 req-d1688b4a-5455-413d-a717-1e8fbf250fe0 service nova] Enqueued Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_members [ 591.199568] env[65381]: INFO networking_nsxv3.common.synchronization [req-04e344f3-799c-480f-ba26-bdd4499e3231 req-d1688b4a-5455-413d-a717-1e8fbf250fe0 service nova] Enqueued Resource ID: 7ac86539-e16b-47ed-b083-746ea8f9d5a5 with Priority: HIGHEST for action port [ 591.200131] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_rules [ 591.200301] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_members [ 591.200401] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac86539-e16b-47ed-b083-746ea8f9d5a5 with Priority: HIGHEST for action port [ 591.200707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.200825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.200901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.201237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.201352] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.203290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.203290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.203290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.203290] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.204265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ac86539-e16b-47ed-b083-746ea8f9d5a5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.205618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.205618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.205618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.205618] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac86539-e16b-47ed-b083-746ea8f9d5a5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.372892] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.372892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.372892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.372892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.372892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.373129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.373200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.373275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.373477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.373560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.373657] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa already deleted. [ 591.373758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.519876] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.519876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.519876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.519876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.520627] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.520627] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.520627] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.520783] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.522258] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.523286] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.523286] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.523286] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.523286] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.523286] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.523286] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.523286] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.543855] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.544035] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.544175] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.544350] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.544894] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-a9e2a5ae-54bf-4938-8789-946422d12e8c taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.544894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.545096] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.545273] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.545835] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9e2a5ae-54bf-4938-8789-946422d12e8c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.706159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.706336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.706466] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.707465] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ac86539-e16b-47ed-b083-746ea8f9d5a5 with status ACTIVE [ 591.707599] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.707742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.707864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.708356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.708466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.708530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.708933] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.709095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.709095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.709265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.709336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.709421] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ac86539-e16b-47ed-b083-746ea8f9d5a5 is going to be updated. [ 591.732178] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.732325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.732467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.732689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.732849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.733016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ac86539-e16b-47ed-b083-746ea8f9d5a5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.885269] env[65381]: INFO networking_nsxv3.common.synchronization [None req-46e402a5-08cb-40cc-930d-b5ae8c828ad5 None None] Enqueued Resource ID: 3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d with Priority: HIGHEST for action port [ 591.885968] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d with Priority: HIGHEST for action port [ 591.887036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.887036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.887036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.887036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.887036] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.966340] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 591.966582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.966802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.966971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.967177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.967308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.967370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.967507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.967588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.967676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.967766] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.048606] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.048606] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.048870] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.048921] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.050530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.050530] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port a9e2a5ae-54bf-4938-8789-946422d12e8c not found, creating... [ 592.050530] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.050530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.050530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.050530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.050530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.050530] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.050530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.050940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.050940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.050940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.051901] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: a9e2a5ae-54bf-4938-8789-946422d12e8c is going to be created. [ 592.072259] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.072458] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.074900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.074900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.074900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.074900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.211531] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.389297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d [ 592.389538] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.389684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.389753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.389964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.390223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.390223] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d already deleted. [ 592.390223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3e958d-c10a-48ef-9c9a-b1dbc83b6b4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.470903] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.471182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.471295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.471549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.471788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.471932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.472025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.472249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.472311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.472392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.472664] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.472664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.472787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.472864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.473009] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.473150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.473150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.473291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.473367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.473443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.473529] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.713807] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.714129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.714129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.716582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.716582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.716582] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2380b72e-771a-447f-bf96-4a7738880121 is going to be created. [ 592.744088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.744088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.744088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.744088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.744088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.753027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2380b72e-771a-447f-bf96-4a7738880121 in Status: UNINITIALIZED for 2s [ 592.816756] env[65381]: INFO networking_nsxv3.common.synchronization [req-7f327626-e28f-453a-aeac-c319d1d9675a req-53d6bf5a-56fa-4840-a0c9-1a9cc25b784e service nova] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 592.817219] env[65381]: INFO networking_nsxv3.common.synchronization [req-7f327626-e28f-453a-aeac-c319d1d9675a req-53d6bf5a-56fa-4840-a0c9-1a9cc25b784e service nova] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 592.817382] env[65381]: INFO networking_nsxv3.common.synchronization [req-7f327626-e28f-453a-aeac-c319d1d9675a req-53d6bf5a-56fa-4840-a0c9-1a9cc25b784e service nova] Enqueued Resource ID: a9e2a5ae-54bf-4938-8789-946422d12e8c with Priority: HIGHEST for action port [ 592.817933] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 592.818189] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 592.818314] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e2a5ae-54bf-4938-8789-946422d12e8c with Priority: HIGHEST for action port [ 592.818815] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.818962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.819087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.819668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.819668] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.820484] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.820615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.820706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.820916] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.821122] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.821249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.821333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.821514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.821627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.821767] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.822607] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9e2a5ae-54bf-4938-8789-946422d12e8c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.822741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.822812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.822963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.823050] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9e2a5ae-54bf-4938-8789-946422d12e8c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.976192] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca937f1d-ad54-42e4-88d0-5a460de400c2: rpc.has_security_group_logging(os_id): False [ 592.995835] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.995999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.996084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.996300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.996395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.996607] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.996712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.996779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.996926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.997012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.997184] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.997279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.997340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.997483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.997557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.997737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.997829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.997889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.998242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.998242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.998359] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be created. [ 593.023125] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b7728275-e2e0-4198-b63a-20a2a5eccf9f None None] Enqueued Resource ID: 3ce38f79-d0b2-497a-94d2-b597d69c7b82 with Priority: HIGHEST for action port [ 593.023125] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce38f79-d0b2-497a-94d2-b597d69c7b82 with Priority: HIGHEST for action port [ 593.023125] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce38f79-d0b2-497a-94d2-b597d69c7b82 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.023125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce38f79-d0b2-497a-94d2-b597d69c7b82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.023125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce38f79-d0b2-497a-94d2-b597d69c7b82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.024721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce38f79-d0b2-497a-94d2-b597d69c7b82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.026812] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce38f79-d0b2-497a-94d2-b597d69c7b82',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.061756] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.061866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.061904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.062536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.062821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.075169] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: IN_PROGRESS for 2s [ 593.286177] env[65381]: INFO networking_nsxv3.common.synchronization [req-f45d084a-42a3-492c-9c88-d04cb116291e req-7f911cee-168f-4560-bb5e-c4674a66cc97 tempest-MigrationsAdminTest-1004936190 tempest-MigrationsAdminTest-1004936190-project-member] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 593.286177] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 593.286177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.286177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.286177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.286177] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.329357] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.329357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.329357] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.329357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9e2a5ae-54bf-4938-8789-946422d12e8c with status ACTIVE [ 593.329683] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.329683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.329802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.329901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.329983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.330173] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.330705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.330804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.332357] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.332357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9e2a5ae-54bf-4938-8789-946422d12e8c is going to be updated. [ 593.355821] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.356624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.356624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.356624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.356624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.356624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.529408] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ce38f79-d0b2-497a-94d2-b597d69c7b82 [ 593.529923] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.529923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.529923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.530140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.530140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.530355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ce38f79-d0b2-497a-94d2-b597d69c7b82 already deleted. [ 593.530416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce38f79-d0b2-497a-94d2-b597d69c7b82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.790437] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.790766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.790766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.790909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.790998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.791219] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.791323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.791387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.791547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.791624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.791708] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a already deleted. [ 593.791882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.834894] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.096937] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.097220] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.097329] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.097633] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.097922] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.098206] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.098385] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.098680] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.098862] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.099160] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.099289] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.099433] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.099648] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.099875] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.100078] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.100286] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.123798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.123983] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.124142] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.124339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.124910] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-d9fe2739-6659-4b80-8ce4-d605288844de taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.124910] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.125103] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.125351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.125503] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9fe2739-6659-4b80-8ce4-d605288844de',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.338500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.338697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.338781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.339036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.339150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.339250] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be created. [ 594.365880] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.365880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.365880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.365880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.366170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.377712] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: UNINITIALIZED for 2s [ 594.563400] env[65381]: INFO networking_nsxv3.common.synchronization [None req-444ea5b1-1bc7-471d-851d-d8a3dd319185 None None] Enqueued Resource ID: 9273919f-04b1-4964-a03f-70c023bb3f1d with Priority: HIGHEST for action port [ 594.563400] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9273919f-04b1-4964-a03f-70c023bb3f1d with Priority: HIGHEST for action port [ 594.563400] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-9273919f-04b1-4964-a03f-70c023bb3f1d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.563400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9273919f-04b1-4964-a03f-70c023bb3f1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.563400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9273919f-04b1-4964-a03f-70c023bb3f1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.563400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9273919f-04b1-4964-a03f-70c023bb3f1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.564080] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9273919f-04b1-4964-a03f-70c023bb3f1d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.631263] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.631263] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port d9fe2739-6659-4b80-8ce4-d605288844de not found, creating... [ 594.631263] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.631263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.631722] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.631722] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.631722] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.632473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.632754] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.633144] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: d9fe2739-6659-4b80-8ce4-d605288844de is going to be created. [ 594.657305] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.657305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.657305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.657305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.657305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.657305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.765072] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2380b72e-771a-447f-bf96-4a7738880121 in Status: SUCCESS [ 594.765072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.765072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.765072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.765379] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.765379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.765508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.765621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.765708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.765785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.765919] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.027618] env[65381]: INFO networking_nsxv3.common.synchronization [None req-7a4f5e62-f35e-4733-898e-70bb0f769a6a None None] Enqueued Resource ID: d3f83260-7051-43b5-ab25-7ce234dc1a57 with Priority: HIGHEST for action port [ 595.028153] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f83260-7051-43b5-ab25-7ce234dc1a57 with Priority: HIGHEST for action port [ 595.028475] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f83260-7051-43b5-ab25-7ce234dc1a57 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.028585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f83260-7051-43b5-ab25-7ce234dc1a57" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.028803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f83260-7051-43b5-ab25-7ce234dc1a57" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.028890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f83260-7051-43b5-ab25-7ce234dc1a57" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.028967] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f83260-7051-43b5-ab25-7ce234dc1a57',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.066737] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9273919f-04b1-4964-a03f-70c023bb3f1d [ 595.068017] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.068017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.068017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.068017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.068017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.068017] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9273919f-04b1-4964-a03f-70c023bb3f1d already deleted. [ 595.068017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9273919f-04b1-4964-a03f-70c023bb3f1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.090546] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 595.090984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.268281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.268281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.268438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.268893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.268893] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.268893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.269383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.269383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.269383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.269383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.269383] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.269565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.269565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.270390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.270390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.270390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.270390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.270390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.270390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.270390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.270390] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.376211] env[65381]: INFO networking_nsxv3.common.synchronization [req-f45d084a-42a3-492c-9c88-d04cb116291e req-59fe37ed-fa08-4fdf-9adb-c1a28092162b service nova] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_rules [ 595.376298] env[65381]: INFO networking_nsxv3.common.synchronization [req-f45d084a-42a3-492c-9c88-d04cb116291e req-59fe37ed-fa08-4fdf-9adb-c1a28092162b service nova] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 595.376429] env[65381]: INFO networking_nsxv3.common.synchronization [req-f45d084a-42a3-492c-9c88-d04cb116291e req-59fe37ed-fa08-4fdf-9adb-c1a28092162b service nova] Enqueued Resource ID: d9fe2739-6659-4b80-8ce4-d605288844de with Priority: HIGHEST for action port [ 595.376635] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_rules [ 595.376757] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 595.376855] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9fe2739-6659-4b80-8ce4-d605288844de with Priority: HIGHEST for action port [ 595.377417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.380487] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.380487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.380487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.380487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.383620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.383620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.383620] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.384971] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9fe2739-6659-4b80-8ce4-d605288844de taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.384971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.384971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.384971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.385460] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9fe2739-6659-4b80-8ce4-d605288844de',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.533212] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3f83260-7051-43b5-ab25-7ce234dc1a57 [ 595.533212] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.533212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.533212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.533212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.533212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.533212] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3f83260-7051-43b5-ab25-7ce234dc1a57 already deleted. [ 595.533618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f83260-7051-43b5-ab25-7ce234dc1a57" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.773318] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2380b72e-771a-447f-bf96-4a7738880121: rpc.has_security_group_logging(os_id): False [ 595.794578] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.794848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.794848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.795086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.795466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.795466] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.795626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.795626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.796160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.796160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.796160] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.796315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.796315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.796462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.796549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.796852] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.796852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.796941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.798033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.798138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.798263] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2380b72e-771a-447f-bf96-4a7738880121 is going to be created. [ 595.860182] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.860842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.861054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.861456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.861753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.873792] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2380b72e-771a-447f-bf96-4a7738880121 in Status: IN_PROGRESS for 2s [ 595.887355] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.888724] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.889093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.889680] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9fe2739-6659-4b80-8ce4-d605288844de with status ACTIVE [ 595.889680] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.889680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.889680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.890062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.890254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.890541] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.891203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.891203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.891203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.891387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.892467] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.892467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.892467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.892467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.892467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.892467] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9fe2739-6659-4b80-8ce4-d605288844de is going to be updated. [ 595.917079] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.917252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.918464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.918464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.918464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.918464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9fe2739-6659-4b80-8ce4-d605288844de" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.137109] env[65381]: INFO networking_nsxv3.common.synchronization [None req-549eecec-73b2-44bf-86b5-44b56747aff6 None None] Enqueued Resource ID: b46323c4-fab9-4f77-886b-6b47f6aee093 with Priority: HIGHEST for action port [ 596.137752] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46323c4-fab9-4f77-886b-6b47f6aee093 with Priority: HIGHEST for action port [ 596.141575] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b46323c4-fab9-4f77-886b-6b47f6aee093 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.141575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b46323c4-fab9-4f77-886b-6b47f6aee093" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.141575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b46323c4-fab9-4f77-886b-6b47f6aee093" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.141575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b46323c4-fab9-4f77-886b-6b47f6aee093" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.141575] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b46323c4-fab9-4f77-886b-6b47f6aee093',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.388528] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 596.388727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.389396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.389396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.389518] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.389595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.389760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.389841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.389923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.390248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.390248] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.395879] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.641989] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b46323c4-fab9-4f77-886b-6b47f6aee093 [ 596.642644] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.642797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.642866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.643099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.643190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.643292] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b46323c4-fab9-4f77-886b-6b47f6aee093 already deleted. [ 596.643457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b46323c4-fab9-4f77-886b-6b47f6aee093" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.718702] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a5eb868a-a2e4-4501-b82c-beca1ce4683c None None] Enqueued Resource ID: ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc with Priority: HIGHEST for action port [ 596.719279] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc with Priority: HIGHEST for action port [ 596.719518] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.719649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.719717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.719953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.721860] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.895013] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.895139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.895195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.895542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.895859] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.896079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.896079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.896207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.896300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.896387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.896532] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.896625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.896685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.896826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.896995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.897097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.897141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.897246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.897318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.897399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.897485] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.898468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.898578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.898641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.898791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.898864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.898946] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be created. [ 596.923349] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.923496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.923562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.923770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.923930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.936652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: UNINITIALIZED for 2s [ 597.225974] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc [ 597.225974] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.225974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.225974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.225974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.225974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.225974] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc already deleted. [ 597.225974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba9ddf1f-8f3b-430b-8d0f-6a457f6ec5dc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.401057] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48eacb50-df32-446c-947a-a00fbf576caa: rpc.has_security_group_logging(os_id): False [ 597.426223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.426342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.427578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.427578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.427578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.427758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.427865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.427933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.428089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.428166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.428353] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.428641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.428641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.428641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.428775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.428881] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.429281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.429281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.429281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.429281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.429448] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be created. [ 597.522451] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.522614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.522655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.522879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.523125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.543032] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 597.887155] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2380b72e-771a-447f-bf96-4a7738880121 in Status: SUCCESS [ 597.889936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.516139] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1b9c2112-7d96-4ab8-8b6d-179015e6edbc None None] Enqueued Resource ID: 39afee16-2175-4788-af90-3e9224c9bd19 with Priority: HIGHEST for action port [ 598.516921] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39afee16-2175-4788-af90-3e9224c9bd19 with Priority: HIGHEST for action port [ 598.520720] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-39afee16-2175-4788-af90-3e9224c9bd19 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.520720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39afee16-2175-4788-af90-3e9224c9bd19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.520720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39afee16-2175-4788-af90-3e9224c9bd19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.520720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39afee16-2175-4788-af90-3e9224c9bd19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.520720] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39afee16-2175-4788-af90-3e9224c9bd19',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.804640] env[65381]: INFO networking_nsxv3.common.synchronization [None req-38411330-9019-4b74-a9cf-5708ee58c9e1 None None] Enqueued Resource ID: 401734e0-9fe8-4435-b5b5-2de4a22035fd with Priority: HIGHEST for action port [ 598.805690] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 401734e0-9fe8-4435-b5b5-2de4a22035fd with Priority: HIGHEST for action port [ 598.806850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-401734e0-9fe8-4435-b5b5-2de4a22035fd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.806958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-401734e0-9fe8-4435-b5b5-2de4a22035fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.807099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-401734e0-9fe8-4435-b5b5-2de4a22035fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.807714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-401734e0-9fe8-4435-b5b5-2de4a22035fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.807790] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('401734e0-9fe8-4435-b5b5-2de4a22035fd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.951285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 598.951285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.951285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.951511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.951706] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.951833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.951894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.952092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.952176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.952270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.952353] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.024225] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39afee16-2175-4788-af90-3e9224c9bd19 [ 599.025022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.025257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.025366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.026031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.026031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.026031] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39afee16-2175-4788-af90-3e9224c9bd19 already deleted. [ 599.026031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39afee16-2175-4788-af90-3e9224c9bd19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.041322] env[65381]: INFO networking_nsxv3.common.synchronization [None req-4a3b3f9c-3477-4ced-bbed-49ee8064d0c9 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 599.042137] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 599.046268] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.046268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.046268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.046727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.046727] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.269052] env[65381]: INFO networking_nsxv3.common.synchronization [None req-ddb0f595-0b40-47e6-b3c5-6a4e18d80fea tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 599.269735] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 599.270900] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.271280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.313289] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 401734e0-9fe8-4435-b5b5-2de4a22035fd [ 599.313289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.313289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.313289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.314216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.314216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.314216] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:401734e0-9fe8-4435-b5b5-2de4a22035fd already deleted. [ 599.314216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-401734e0-9fe8-4435-b5b5-2de4a22035fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.455877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.456099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.456158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.456342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.456504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.456614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.456706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.456930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.456992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.457126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.457257] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.457333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.457387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.457785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.457785] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.457785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.457966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.458709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.458709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.458709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.458709] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.553951] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 599.554454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.567858] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.568102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.568102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.568320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.568432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.568531] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 already deleted. [ 599.568643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.568805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.568959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.569051] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.961531] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb17e366-3b38-46cd-836a-5d640fa33c5a: rpc.has_security_group_logging(os_id): False [ 599.980881] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.981254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.981319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.981555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.981663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.981881] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.982132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.982203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.982357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.982437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.982646] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.982747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.982813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.982964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.983070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.983305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.983412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.983543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.983602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.983655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.983716] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be created. [ 600.048330] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.048496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.048573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.048764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.049833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.062418] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: IN_PROGRESS for 2s [ 600.092547] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.092777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.092899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.093099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.093249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.093438] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 already deleted. [ 600.093610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.901455] env[65381]: INFO networking_nsxv3.common.synchronization [req-f3408ae1-3ba6-4c52-be30-8f58a5dab8b5 req-74130a99-143b-4c7a-8e67-6749fb15a172 tempest-VolumesAssistedSnapshotsTest-911230567 tempest-VolumesAssistedSnapshotsTest-911230567-project-member] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_members [ 601.905036] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_members [ 601.905674] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.905674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.905908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.906155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.906474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.906581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.906778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.906947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.907094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.911354] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.077106] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 602.077381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.299173] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1ab991ad-bf4a-4536-8e42-27621eaba88e None None] Enqueued Resource ID: 3cc736fa-240a-4150-a22e-f4a17ff68c1a with Priority: HIGHEST for action port [ 602.299749] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc736fa-240a-4150-a22e-f4a17ff68c1a with Priority: HIGHEST for action port [ 602.300087] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cc736fa-240a-4150-a22e-f4a17ff68c1a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.300213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cc736fa-240a-4150-a22e-f4a17ff68c1a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.300279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cc736fa-240a-4150-a22e-f4a17ff68c1a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.300587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cc736fa-240a-4150-a22e-f4a17ff68c1a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.300705] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cc736fa-240a-4150-a22e-f4a17ff68c1a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.385734] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-303 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.386195] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.386365] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.386895] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.387233] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.387447] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.387698] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.388307] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.388569] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.388807] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.388958] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.389101] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.389255] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.389369] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.389473] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.389603] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.411621] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.411892] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.412070] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.412905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.412905] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.412905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.412905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.413717] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.413717] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd98ab0-3d9f-439d-84ce-0934da7ad0f1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.418770] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.419202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.419317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.419548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.419671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.419891] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.420041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.420206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.420331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.420450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.420550] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c2d48d-c321-4e23-999d-809958401c70 already deleted. [ 602.420656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.494037] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6cfaab6e-1eff-4177-83bf-77604b6f3d4e None None] Enqueued Resource ID: 3814659e-e9ce-48a9-91b7-ab7ed3d7113f with Priority: HIGHEST for action port [ 602.494408] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3814659e-e9ce-48a9-91b7-ab7ed3d7113f with Priority: HIGHEST for action port [ 602.494604] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3814659e-e9ce-48a9-91b7-ab7ed3d7113f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.494722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3814659e-e9ce-48a9-91b7-ab7ed3d7113f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.494785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3814659e-e9ce-48a9-91b7-ab7ed3d7113f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.495070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3814659e-e9ce-48a9-91b7-ab7ed3d7113f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.497035] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3814659e-e9ce-48a9-91b7-ab7ed3d7113f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.807624] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cc736fa-240a-4150-a22e-f4a17ff68c1a [ 602.808482] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.809133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.809473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.809917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.810124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.810314] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cc736fa-240a-4150-a22e-f4a17ff68c1a already deleted. [ 602.810576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cc736fa-240a-4150-a22e-f4a17ff68c1a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.916657] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.917496] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.918339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.918918] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.918918] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.919119] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 not found, creating... [ 602.919580] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.920026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.920026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.920352] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.920577] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.921042] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.921272] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.922033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.922033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.922033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.922033] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 is going to be created. [ 602.956454] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.956454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.956454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.956454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.956454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.957194] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.998983] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3814659e-e9ce-48a9-91b7-ab7ed3d7113f [ 602.999137] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.999610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.999726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.999989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.000191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.000295] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3814659e-e9ce-48a9-91b7-ab7ed3d7113f already deleted. [ 603.000556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3814659e-e9ce-48a9-91b7-ab7ed3d7113f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.501545] env[65381]: INFO networking_nsxv3.common.synchronization [None req-9a74bc8e-2a14-41ee-b794-ad7b33958cb9 tempest-ServersWithSpecificFlavorTestJSON-513012973 tempest-ServersWithSpecificFlavorTestJSON-513012973-project-member] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 603.501545] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 603.501545] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.501545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.501545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.501545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.501545] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.777597] env[65381]: INFO networking_nsxv3.common.synchronization [req-f3408ae1-3ba6-4c52-be30-8f58a5dab8b5 req-f20e4df8-c6ab-487d-9098-5f0b98e2a7bc service nova] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_rules [ 603.777775] env[65381]: INFO networking_nsxv3.common.synchronization [req-f3408ae1-3ba6-4c52-be30-8f58a5dab8b5 req-f20e4df8-c6ab-487d-9098-5f0b98e2a7bc service nova] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_members [ 603.777906] env[65381]: INFO networking_nsxv3.common.synchronization [req-f3408ae1-3ba6-4c52-be30-8f58a5dab8b5 req-f20e4df8-c6ab-487d-9098-5f0b98e2a7bc service nova] Enqueued Resource ID: fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 with Priority: HIGHEST for action port [ 603.778465] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_rules [ 603.778606] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_members [ 603.778702] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 with Priority: HIGHEST for action port [ 603.779099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.783048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.783124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.783355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.783441] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.784377] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.784508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.784614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.784803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.786265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.786495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.786545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.786729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.786851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.786974] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.787896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.788031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.788090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.788236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.788314] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcd98ab0-3d9f-439d-84ce-0934da7ad0f1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.805780] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a3dc3a03-7b4d-45b2-a8f8-d2a9a41de1c5 tempest-ServersWithSpecificFlavorTestJSON-513012973 tempest-ServersWithSpecificFlavorTestJSON-513012973-project-member] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 603.806595] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 603.806851] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.806948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.028829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.029167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.029167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.029323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.029359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.030711] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e already deleted. [ 604.030711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.030711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.030711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.030711] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.290770] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.291814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.292035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.292099] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 with status ACTIVE [ 604.292235] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.292342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.292405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.292773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.292895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.293099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.293208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.293455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.293455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.293611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.293798] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.293891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.293957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.294116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.294188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.294305] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcd98ab0-3d9f-439d-84ce-0934da7ad0f1 is going to be updated. [ 604.320805] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.320805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.320805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.320805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.320805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.321181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcd98ab0-3d9f-439d-84ce-0934da7ad0f1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.428819] env[65381]: INFO networking_nsxv3.common.synchronization [req-f9149bbb-387a-4579-8b76-7881500d97f6 req-4f5ff69e-b340-45d8-b37a-8c3b8fa5df80 tempest-ServersTestFqdnHostnames-1355028209 tempest-ServersTestFqdnHostnames-1355028209-project-member] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_members [ 604.430911] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_members [ 604.431295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.431429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.431495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.431954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.431954] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.432127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.432127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.432278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.432468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.432468] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.557092] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.557312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.557694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.557954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.558145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.558212] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e already deleted. [ 604.558325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.797763] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.858022] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.858022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-706" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.858022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-706" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.858022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-706" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.858022] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.858509] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.861643] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.861643] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.861643] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.861643] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.861643] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.861643] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.861643] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.861643] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.861643] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.861643] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.880605] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.880829] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.881019] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.881226] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-706" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.881587] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.881816] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.881950] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.882364] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.882451] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72130e1-7adc-4f6d-bc0e-22c89b3b863c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.891729] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5d6744c8-4c2a-4995-8e2c-6799e95fc099 None None] Enqueued Resource ID: 36edce7c-c8b6-4c1d-884b-5a3b69ba6423 with Priority: HIGHEST for action port [ 604.892231] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36edce7c-c8b6-4c1d-884b-5a3b69ba6423 with Priority: HIGHEST for action port [ 604.892520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-36edce7c-c8b6-4c1d-884b-5a3b69ba6423 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.892663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36edce7c-c8b6-4c1d-884b-5a3b69ba6423" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.892748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36edce7c-c8b6-4c1d-884b-5a3b69ba6423" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.892993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36edce7c-c8b6-4c1d-884b-5a3b69ba6423" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.893104] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36edce7c-c8b6-4c1d-884b-5a3b69ba6423',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.935811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.936031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.936031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.936264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.936371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.936825] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.936971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.937057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.937371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.937476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.937606] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 already deleted. [ 604.937707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.299873] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.300144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.300144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.300351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.300436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.300542] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c2d48d-c321-4e23-999d-809958401c70 is going to be created. [ 605.331531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.331746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.331799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.332072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.332244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.342919] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c2d48d-c321-4e23-999d-809958401c70 in Status: UNINITIALIZED for 2s [ 605.384499] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.384765] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.384844] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.385506] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.385506] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.385506] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port f72130e1-7adc-4f6d-bc0e-22c89b3b863c not found, creating... [ 605.386237] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.386237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.386237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.386237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.386532] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.386748] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.387841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.387841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.387841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.387841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.387841] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: f72130e1-7adc-4f6d-bc0e-22c89b3b863c is going to be created. [ 605.395101] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36edce7c-c8b6-4c1d-884b-5a3b69ba6423 [ 605.395340] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.395476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.395546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.395753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.395862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.395959] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36edce7c-c8b6-4c1d-884b-5a3b69ba6423 already deleted. [ 605.396086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36edce7c-c8b6-4c1d-884b-5a3b69ba6423" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.420710] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.420907] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.421042] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.421361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.421660] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.422115] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.871398] env[65381]: INFO networking_nsxv3.common.synchronization [None req-0d5c76ae-8778-47e8-91eb-609c0abe7cc6 None None] Enqueued Resource ID: 240aad37-571d-4f16-b9e8-fd04b4dd5d30 with Priority: HIGHEST for action port [ 605.871915] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240aad37-571d-4f16-b9e8-fd04b4dd5d30 with Priority: HIGHEST for action port [ 605.872241] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-240aad37-571d-4f16-b9e8-fd04b4dd5d30 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.872369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-240aad37-571d-4f16-b9e8-fd04b4dd5d30" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.872425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-240aad37-571d-4f16-b9e8-fd04b4dd5d30" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.872707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-240aad37-571d-4f16-b9e8-fd04b4dd5d30" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.872784] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240aad37-571d-4f16-b9e8-fd04b4dd5d30',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.111399] env[65381]: INFO networking_nsxv3.common.synchronization [req-f9149bbb-387a-4579-8b76-7881500d97f6 req-e6c4ffce-5268-4866-bf5f-5ce9d056a6d8 service nova] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_rules [ 606.111657] env[65381]: INFO networking_nsxv3.common.synchronization [req-f9149bbb-387a-4579-8b76-7881500d97f6 req-e6c4ffce-5268-4866-bf5f-5ce9d056a6d8 service nova] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_members [ 606.111760] env[65381]: INFO networking_nsxv3.common.synchronization [req-f9149bbb-387a-4579-8b76-7881500d97f6 req-e6c4ffce-5268-4866-bf5f-5ce9d056a6d8 service nova] Enqueued Resource ID: f72130e1-7adc-4f6d-bc0e-22c89b3b863c with Priority: HIGHEST for action port [ 606.112795] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_rules [ 606.112795] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_members [ 606.112795] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f72130e1-7adc-4f6d-bc0e-22c89b3b863c with Priority: HIGHEST for action port [ 606.112988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.113422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.113665] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.114579] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.115016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.115737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.115960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.117137] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.117211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.117314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.117402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.117485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.117577] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.120152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.120251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.120311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.120501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.120577] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f72130e1-7adc-4f6d-bc0e-22c89b3b863c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.376408] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 240aad37-571d-4f16-b9e8-fd04b4dd5d30 [ 606.376653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.377150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.377150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.379688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.379688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.379688] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:240aad37-571d-4f16-b9e8-fd04b4dd5d30 already deleted. [ 606.379688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-240aad37-571d-4f16-b9e8-fd04b4dd5d30" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.621946] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.622108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.622312] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.623240] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f72130e1-7adc-4f6d-bc0e-22c89b3b863c with status ACTIVE [ 606.623427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.623543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.623609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.623830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.623951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.624097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.624220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.624308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.624400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.624476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.624880] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.625681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.625681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.625681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.625681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.625681] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f72130e1-7adc-4f6d-bc0e-22c89b3b863c is going to be updated. [ 606.650032] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.650407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.650407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.652018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.652592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.652592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f72130e1-7adc-4f6d-bc0e-22c89b3b863c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.685092] env[65381]: INFO networking_nsxv3.common.synchronization [req-d2746a85-3992-424b-9475-a07ce0206087 req-faa4240d-544a-44fa-88fb-ddc6f53c95a2 tempest-ServerMetadataTestJSON-1695680042 tempest-ServerMetadataTestJSON-1695680042-project-member] Enqueued Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_members [ 606.685598] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_members [ 606.685885] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.685999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.686068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.686327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.686481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.686587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.686641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.686787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.686865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.686954] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.123022] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.123022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-988" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.123022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-988" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.123304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-988" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.123444] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.123603] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.123714] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.123947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.124092] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.124313] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.124417] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.124524] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.124620] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.124721] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.124819] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.126073] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.127319] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.156444] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.156614] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.156748] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.156924] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-988" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.157270] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-135b9019-dae0-458c-b526-e4204c6a1380 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.157442] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.157557] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.157871] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.158009] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('135b9019-dae0-458c-b526-e4204c6a1380',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.191035] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.191035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.191035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.191035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.191035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.191326] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.191326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.191427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.191574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.191693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.191792] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a already deleted. [ 607.191900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.355112] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c2d48d-c321-4e23-999d-809958401c70 in Status: SUCCESS [ 607.355402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.355577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.355827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.356026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.356145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.356233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.356468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.356512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.356570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.356658] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.632714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.632714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.633168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.633168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.633314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.633464] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 is going to be created. [ 607.660823] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.661411] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.661598] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.661920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.662085] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.662244] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 135b9019-dae0-458c-b526-e4204c6a1380 not found, creating... [ 607.662513] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.662687] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.662845] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.663088] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.663232] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.663519] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.664212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.664212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.664212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.664410] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.664465] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 135b9019-dae0-458c-b526-e4204c6a1380 is going to be created. [ 607.666328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.666501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.666633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.666814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.667019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.681047] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 in Status: UNINITIALIZED for 2s [ 607.692243] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.692555] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.692756] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.693176] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.693526] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.693864] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.861456] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.364508] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61c2d48d-c321-4e23-999d-809958401c70: rpc.has_security_group_logging(os_id): False [ 608.368247] env[65381]: INFO networking_nsxv3.common.synchronization [req-d2746a85-3992-424b-9475-a07ce0206087 req-27d1e0e3-ad15-411c-8475-09e69eda99c0 service nova] Enqueued Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_rules [ 608.369257] env[65381]: INFO networking_nsxv3.common.synchronization [req-d2746a85-3992-424b-9475-a07ce0206087 req-27d1e0e3-ad15-411c-8475-09e69eda99c0 service nova] Enqueued Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_members [ 608.369257] env[65381]: INFO networking_nsxv3.common.synchronization [req-d2746a85-3992-424b-9475-a07ce0206087 req-27d1e0e3-ad15-411c-8475-09e69eda99c0 service nova] Enqueued Resource ID: 135b9019-dae0-458c-b526-e4204c6a1380 with Priority: HIGHEST for action port [ 608.369399] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_rules [ 608.369592] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_members [ 608.369762] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 135b9019-dae0-458c-b526-e4204c6a1380 with Priority: HIGHEST for action port [ 608.370224] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.370334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.370399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.370737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.370806] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.372394] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.372482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.372546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.372745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.372988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.373262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.373327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.374457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.374457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.374457] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.375397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-135b9019-dae0-458c-b526-e4204c6a1380 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.375622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.375704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.375893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.375972] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('135b9019-dae0-458c-b526-e4204c6a1380',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.383424] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.383559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.383621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.384341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.384341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.384341] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.384341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.384341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.384583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.384583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.384652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c2d48d-c321-4e23-999d-809958401c70 is going to be created. [ 608.463826] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.463826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.463826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.464277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.465678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.478060] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61c2d48d-c321-4e23-999d-809958401c70 in Status: IN_PROGRESS for 2s [ 608.581546] env[65381]: INFO networking_nsxv3.common.synchronization [None req-8184948b-00b2-4085-bd18-91d8339fc7a3 None None] Enqueued Resource ID: d9685f10-549d-4101-90f7-4b0eb43a29fa with Priority: HIGHEST for action port [ 608.582302] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9685f10-549d-4101-90f7-4b0eb43a29fa with Priority: HIGHEST for action port [ 608.582662] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9685f10-549d-4101-90f7-4b0eb43a29fa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.582967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9685f10-549d-4101-90f7-4b0eb43a29fa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.582967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9685f10-549d-4101-90f7-4b0eb43a29fa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.583346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9685f10-549d-4101-90f7-4b0eb43a29fa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.583523] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9685f10-549d-4101-90f7-4b0eb43a29fa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.876529] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.878139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 135b9019-dae0-458c-b526-e4204c6a1380 with status ACTIVE [ 608.878139] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.878306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.878345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.878830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.878830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.878830] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.878998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.878998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.879129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.879207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.879384] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.879557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.879557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.879669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.879871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.879871] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 135b9019-dae0-458c-b526-e4204c6a1380 is going to be updated. [ 608.886347] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.886494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.909205] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.909205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.909205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.909205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.909205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.909400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-135b9019-dae0-458c-b526-e4204c6a1380" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.085655] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9685f10-549d-4101-90f7-4b0eb43a29fa [ 609.086107] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.086107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.086308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.086363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.086461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.086556] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9685f10-549d-4101-90f7-4b0eb43a29fa already deleted. [ 609.086678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9685f10-549d-4101-90f7-4b0eb43a29fa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.345806] env[65381]: INFO networking_nsxv3.common.synchronization [req-df0b5fdd-2af9-46fd-a7d5-e6d95f09ac7b req-d769d0e7-49ec-4445-bf03-e3433e168d87 tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 609.346613] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 609.347900] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.347900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.347900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.347900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.347900] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.348241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.348241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.348396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.348544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.348672] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.387764] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.693667] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 in Status: SUCCESS [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.696714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.696714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.696714] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.851384] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.851659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.851772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.852027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.852578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.853437] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.853437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.853437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.853437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.853437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.853437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 already deleted. [ 609.853865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.894285] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.894285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.894285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.894285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.894285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.894285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a is going to be created. [ 609.920442] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.921294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.921294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.921294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.921465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.936450] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a in Status: UNINITIALIZED for 2s [ 609.956825] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.957071] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.957297] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.957605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.957888] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.958067] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.958222] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.958451] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.958556] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.958765] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.958881] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.958979] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.959097] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.959203] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.959396] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.959567] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.999232] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.999406] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.999585] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.999828] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.000200] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-b3cedc50-5f29-4c50-a607-542be34eebd7 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.000396] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.000576] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.000922] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.001072] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3cedc50-5f29-4c50-a607-542be34eebd7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.199210] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.494639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61c2d48d-c321-4e23-999d-809958401c70 in Status: SUCCESS [ 610.494639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.504039] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.504039] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.504039] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.504346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.504346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.504457] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port b3cedc50-5f29-4c50-a607-542be34eebd7 not found, creating... [ 610.504900] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.504900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.505137] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.505327] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.505469] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.505868] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.506070] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.506139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.506324] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.506461] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.506625] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: b3cedc50-5f29-4c50-a607-542be34eebd7 is going to be created. [ 610.532239] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.532454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.532573] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.532855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.533101] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.533325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.702266] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0109d178-d310-4d94-9ce8-74560a55bfa3: rpc.has_security_group_logging(os_id): False [ 610.724033] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.724033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.724242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.726635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.726635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.726635] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.726635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.726635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.726635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.726635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.726635] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 is going to be created. [ 610.814473] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.814658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.814746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.814951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.815213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.834047] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 in Status: IN_PROGRESS for 2s [ 611.401412] env[65381]: INFO networking_nsxv3.common.synchronization [req-df0b5fdd-2af9-46fd-a7d5-e6d95f09ac7b req-efb367c6-dabb-42f6-9af9-757d2409e55b service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 611.401696] env[65381]: INFO networking_nsxv3.common.synchronization [req-df0b5fdd-2af9-46fd-a7d5-e6d95f09ac7b req-efb367c6-dabb-42f6-9af9-757d2409e55b service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 611.401696] env[65381]: INFO networking_nsxv3.common.synchronization [req-df0b5fdd-2af9-46fd-a7d5-e6d95f09ac7b req-efb367c6-dabb-42f6-9af9-757d2409e55b service nova] Enqueued Resource ID: b3cedc50-5f29-4c50-a607-542be34eebd7 with Priority: HIGHEST for action port [ 611.402094] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 611.402237] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 611.402336] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cedc50-5f29-4c50-a607-542be34eebd7 with Priority: HIGHEST for action port [ 611.403399] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.403399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.403399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.404879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.405538] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.406437] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.406437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.406437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.406437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.406437] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.406663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.406663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.406663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.406813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.406854] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.409195] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3cedc50-5f29-4c50-a607-542be34eebd7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.409195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.409468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.409642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.409742] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3cedc50-5f29-4c50-a607-542be34eebd7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.471367] env[65381]: INFO networking_nsxv3.common.synchronization [req-3122652b-6b4f-4eb6-aa2f-b131aeef2c02 req-9ea16b3a-46ea-4c54-a2ed-a02e4db04e5a tempest-ListImageFiltersTestJSON-1885631896 tempest-ListImageFiltersTestJSON-1885631896-project-member] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 611.471922] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 611.472527] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.472673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.472746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.473115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.473289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.473411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.473466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.474123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.474222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.474321] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.874524] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.875351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.875627] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875715] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.876160] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.876242] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.876416] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.876525] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.876631] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.876735] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.876836] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.876937] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.877104] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.897616] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.897923] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.898159] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.898638] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.899194] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.899478] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.899707] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.900257] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.900597] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f24b528-3e27-42be-aaf4-4cc72b70a2aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.910109] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.912094] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.912094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.913784] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3cedc50-5f29-4c50-a607-542be34eebd7 with status ACTIVE [ 611.913784] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.913966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.913966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.914183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.914323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.914548] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.914720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.914720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.914885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.914975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.915174] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.915334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.915406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.915776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.915776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.915776] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3cedc50-5f29-4c50-a607-542be34eebd7 is going to be updated. [ 611.949030] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a in Status: SUCCESS [ 611.949030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.949030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.949232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.949594] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.949830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.950082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.950371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.950638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.950824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.951064] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.957288] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.957429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.957429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.957581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.957715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.957878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3cedc50-5f29-4c50-a607-542be34eebd7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.977678] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.977901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.978028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.978312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.978463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.978764] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.978937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.979101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.979328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.979456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.979680] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 already deleted. [ 611.979829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.404223] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.404646] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.404861] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.405163] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.405393] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.405629] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 2f24b528-3e27-42be-aaf4-4cc72b70a2aa not found, creating... [ 612.406061] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.406299] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.406483] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.406804] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.407042] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.407481] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.407855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.407925] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.408214] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.408425] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.408654] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 2f24b528-3e27-42be-aaf4-4cc72b70a2aa is going to be created. [ 612.412920] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.430340] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.430612] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.430887] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.431197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.431426] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.431655] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.454288] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.454288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.454288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.454510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.454677] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.454781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.454847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.455047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.455142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.455234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.455388] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.455491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.455574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.455730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.455888] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.455988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.456062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.456199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.456279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.456359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.456463] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.847601] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 in Status: SUCCESS [ 612.847820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.915231] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.915438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.915496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.915681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.915947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.915947] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be created. [ 612.942737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.942954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.942954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.943182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.943345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.956354] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: UNINITIALIZED for 2s [ 612.958766] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b58c566-5d76-43c3-8ec7-fbe48a220f7a: rpc.has_security_group_logging(os_id): False [ 612.984905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.985161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.985161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.985387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.985387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.985603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.985705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.985767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.985956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.986049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.986225] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.986332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.986375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.986519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.986589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.986779] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.986860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.986976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.987278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.987365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.987451] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a is going to be created. [ 613.053962] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.054238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.054238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.054383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.054564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.067357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a in Status: IN_PROGRESS for 2s [ 613.139206] env[65381]: INFO networking_nsxv3.common.synchronization [req-3122652b-6b4f-4eb6-aa2f-b131aeef2c02 req-d417970a-be2c-4a42-b9e8-a284d171d73c service nova] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_rules [ 613.139383] env[65381]: INFO networking_nsxv3.common.synchronization [req-3122652b-6b4f-4eb6-aa2f-b131aeef2c02 req-d417970a-be2c-4a42-b9e8-a284d171d73c service nova] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 613.139477] env[65381]: INFO networking_nsxv3.common.synchronization [req-3122652b-6b4f-4eb6-aa2f-b131aeef2c02 req-d417970a-be2c-4a42-b9e8-a284d171d73c service nova] Enqueued Resource ID: 2f24b528-3e27-42be-aaf4-4cc72b70a2aa with Priority: HIGHEST for action port [ 613.140336] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_rules [ 613.140423] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 613.140609] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f24b528-3e27-42be-aaf4-4cc72b70a2aa with Priority: HIGHEST for action port [ 613.141258] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.141258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.141258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.141597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.141719] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.143024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.143146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.143268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.143560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.143804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.143975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.144085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.144314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.144449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.144573] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.146146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.146318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.146423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.146649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.146767] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f24b528-3e27-42be-aaf4-4cc72b70a2aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.576252] env[65381]: INFO networking_nsxv3.common.synchronization [None req-d5bdad9c-9616-4e28-be99-ec07c321263d None None] Enqueued Resource ID: 5c820f7d-4a92-4269-8722-8e2799a8025c with Priority: HIGHEST for action port [ 613.580140] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c820f7d-4a92-4269-8722-8e2799a8025c with Priority: HIGHEST for action port [ 613.584606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c820f7d-4a92-4269-8722-8e2799a8025c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.584606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c820f7d-4a92-4269-8722-8e2799a8025c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.584606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c820f7d-4a92-4269-8722-8e2799a8025c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.584606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c820f7d-4a92-4269-8722-8e2799a8025c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.584606] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c820f7d-4a92-4269-8722-8e2799a8025c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.649404] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.651695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.651695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.651695] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f24b528-3e27-42be-aaf4-4cc72b70a2aa with status ACTIVE [ 613.651695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.651695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.651695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.651695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.651695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.652474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.652474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.652474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.652474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.652474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.652474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.652907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f24b528-3e27-42be-aaf4-4cc72b70a2aa is going to be updated. [ 613.681577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.681577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.681577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.681577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.681577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.681577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f24b528-3e27-42be-aaf4-4cc72b70a2aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.922293] env[65381]: INFO networking_nsxv3.common.synchronization [req-dae534bd-b49a-4eed-a50e-576a25f0eb4e req-2ca1daf7-c2af-48ab-81a1-e67549311dc2 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 613.922487] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 613.922882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.923014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.923014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.923249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.923408] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.923512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.923569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.923713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.923847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.923899] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.086802] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c820f7d-4a92-4269-8722-8e2799a8025c [ 614.087337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.087513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.087629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.087896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.087990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.088104] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c820f7d-4a92-4269-8722-8e2799a8025c already deleted. [ 614.088192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c820f7d-4a92-4269-8722-8e2799a8025c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.155382] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.378375] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.378375] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-954" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.378375] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-954" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.378533] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-954" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.378792] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.378899] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.379183] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.379183] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.379317] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.379509] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.379616] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.379873] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.379873] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.380037] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.380204] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.380263] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.401634] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.401634] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.401820] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.401936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-954" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.402229] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-55234d07-fb90-41b4-b227-6df6d4dd7ac0 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.402423] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.402524] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.402856] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.403030] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55234d07-fb90-41b4-b227-6df6d4dd7ac0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.425978] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.426154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.426217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.426431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.426518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.426711] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.426809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.426891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.427077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.427158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.427246] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 already deleted. [ 614.427372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.663534] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.663847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.663847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.663991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.664089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.664187] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be created. [ 614.690240] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.690240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.690240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.690437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.690617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.702742] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: UNINITIALIZED for 2s [ 614.905562] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.905562] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.905562] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.905823] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.905956] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.906115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 55234d07-fb90-41b4-b227-6df6d4dd7ac0 not found, creating... [ 614.906357] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.906615] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.906615] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.907209] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.907209] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.907209] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.907392] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.907480] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.907674] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.907816] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.907948] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 is going to be created. [ 614.929728] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.929728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.929908] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.930476] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.930476] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.930476] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.966704] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 614.966837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.968387] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.968387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.968387] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.088722] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a in Status: SUCCESS [ 615.088957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.130063] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 615.130273] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 615.130865] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 615.131190] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 615.133185] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.133185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.133185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.133526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.133562] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.133728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.133813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.133958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.134075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.134176] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.135422] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.135422] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.135422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.135422] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.191268] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 615.191456] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 615.191630] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_rules [ 615.191754] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 615.191868] env[65381]: INFO networking_nsxv3.common.synchronization [req-4dd160f2-ebc9-4f59-9a91-a11d51253b8c req-7c038464-31b8-4422-83cd-b122a8c6f167 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: a9e2a5ae-54bf-4938-8789-946422d12e8c with Priority: HIGHEST for action port [ 615.192468] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 615.192607] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_rules [ 615.192711] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e2a5ae-54bf-4938-8789-946422d12e8c with Priority: HIGHEST for action port [ 615.192802] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 615.192933] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 615.193263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.193371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.193462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.193664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.193745] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.197767] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.197767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.197767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.197767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.197767] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.197767] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9e2a5ae-54bf-4938-8789-946422d12e8c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.197767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.197767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.198139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.198139] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9e2a5ae-54bf-4938-8789-946422d12e8c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.199177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.199300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.199662] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.199662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.475040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.475040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.475040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.475040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.475740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.475740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.475740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.475740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.475740] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.637592] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.638951] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.701061] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9e2a5ae-54bf-4938-8789-946422d12e8c with status ACTIVE [ 615.701577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.701577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.701577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.701874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.701968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.702174] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.702301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.702359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.702572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.702572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.702745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.702837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.702895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.703041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.703113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.703252] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9e2a5ae-54bf-4938-8789-946422d12e8c is going to be updated. [ 615.704719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.704879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.705295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.705295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.731294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.731446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.731571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.731910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.732098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.732299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.766893] env[65381]: INFO networking_nsxv3.common.synchronization [req-dae534bd-b49a-4eed-a50e-576a25f0eb4e req-6b0a5914-bf27-4a33-b590-5c6eb64b62c1 service nova] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 615.767433] env[65381]: INFO networking_nsxv3.common.synchronization [req-dae534bd-b49a-4eed-a50e-576a25f0eb4e req-6b0a5914-bf27-4a33-b590-5c6eb64b62c1 service nova] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 615.767433] env[65381]: INFO networking_nsxv3.common.synchronization [req-dae534bd-b49a-4eed-a50e-576a25f0eb4e req-6b0a5914-bf27-4a33-b590-5c6eb64b62c1 service nova] Enqueued Resource ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with Priority: HIGHEST for action port [ 615.768119] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 615.768305] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 615.768537] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with Priority: HIGHEST for action port [ 615.768938] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.769153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.769238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.769481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.769688] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.771124] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.771124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.771124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.771457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.771689] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.771861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.771977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.772208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.772341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.772593] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.774077] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-55234d07-fb90-41b4-b227-6df6d4dd7ac0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.774315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.774467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.774806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.775201] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55234d07-fb90-41b4-b227-6df6d4dd7ac0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.900477] env[65381]: INFO networking_nsxv3.common.synchronization [None req-91318b8b-e808-4dc5-a33f-7f3d3755acdb None None] Enqueued Resource ID: 7fc59647-6c5f-46f4-a63a-33339c6f094d with Priority: HIGHEST for action port [ 615.900477] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fc59647-6c5f-46f4-a63a-33339c6f094d with Priority: HIGHEST for action port [ 615.900993] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fc59647-6c5f-46f4-a63a-33339c6f094d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.901391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fc59647-6c5f-46f4-a63a-33339c6f094d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.901600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fc59647-6c5f-46f4-a63a-33339c6f094d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.902324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fc59647-6c5f-46f4-a63a-33339c6f094d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.902551] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fc59647-6c5f-46f4-a63a-33339c6f094d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.984297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca1b5748-90c1-473a-ab4f-767cc4ab05d7: rpc.has_security_group_logging(os_id): False [ 616.009074] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.009074] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.009074] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.009074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.009987] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.009987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.009987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.011379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.011379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.011379] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be created. [ 616.083038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.083038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.083038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.083038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.083038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.097284] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 616.140926] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.142089] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.183293] env[65381]: INFO networking_nsxv3.common.synchronization [req-f6c3545b-c10d-45e7-9b3f-83756c073d99 req-026ca416-3313-4bb9-ad3d-cf0fe2020b2b tempest-SecurityGroupRulesNegativeTestJSON-515630460 tempest-SecurityGroupRulesNegativeTestJSON-515630460-project-member] Enqueued Resource ID: c68da681-6ebb-4794-8540-55eddad18a1e with Priority: HIGHEST for action security_group_rules [ 616.183293] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c68da681-6ebb-4794-8540-55eddad18a1e with Priority: HIGHEST for action security_group_rules [ 616.183639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c68da681-6ebb-4794-8540-55eddad18a1e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.183773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.183851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.184111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.184222] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c68da681-6ebb-4794-8540-55eddad18a1e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.279217] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.279217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.279217] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.285021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with status ACTIVE [ 616.285021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.285021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.285021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.285021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.285021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 is going to be updated. [ 616.312644] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.312804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.312893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.313165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.313493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.313801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.405642] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fc59647-6c5f-46f4-a63a-33339c6f094d [ 616.405966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.406524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.406524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.406699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.406795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.406933] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fc59647-6c5f-46f4-a63a-33339c6f094d already deleted. [ 616.407083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fc59647-6c5f-46f4-a63a-33339c6f094d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.648532] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.648750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.648750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.648947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.649087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.649224] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be created. [ 616.650603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.650743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.650864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.651008] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.651927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.651927] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 616.676981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.677733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.677733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.677733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.677733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.688097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.688341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.688341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.689600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.689600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.693146] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: UNINITIALIZED for 2s [ 616.703867] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 616.714274] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: UNINITIALIZED for 4s [ 616.722326] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.722485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.722551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.722701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.722816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.722942] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c68da681-6ebb-4794-8540-55eddad18a1e already deleted. [ 616.723114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.782670] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.061161] env[65381]: INFO networking_nsxv3.common.synchronization [req-08e11337-1cd4-46cc-aee1-c5125e2a2eaa req-01a36104-4074-4405-8c1f-68c868c13918 tempest-ServerDiagnosticsTest-1125027654 tempest-ServerDiagnosticsTest-1125027654-project-member] Enqueued Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_members [ 617.062609] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_members [ 617.062609] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.062609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.062609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.062923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.062923] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.062923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.063116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.063151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.063221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.063309] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.285295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.285680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.285766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.286420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.286524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.287268] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be created. [ 617.317270] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.319151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.319367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.319711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.319895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.335220] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: UNINITIALIZED for 2s [ 617.472142] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.472364] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.472531] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.472833] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.473137] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.473420] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.473535] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.473802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.473971] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.474270] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.474382] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.475118] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.475307] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.475517] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.475579] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.475713] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.496043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.496249] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.496249] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.496415] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.496767] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.496941] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.497535] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.497535] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.497535] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3aef1bd-4b76-4116-9d04-ac11bfa3f479',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.566622] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.567059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.567059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.567059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.567059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.567354] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.567354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.567615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.567615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.567615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.567798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 already deleted. [ 617.567798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.758368] env[65381]: INFO networking_nsxv3.common.synchronization [req-c05d1140-bfa1-411c-9936-e68333171fc3 req-d5b5140a-21fc-40ba-89aa-fbf031401f68 tempest-DeleteServersAdminTestJSON-625374370 tempest-DeleteServersAdminTestJSON-625374370-project-admin] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 617.758985] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 617.759305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.759426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.759541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.759691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.759859] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.759949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.760010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.760152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.760234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.760353] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.000150] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.000150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.000150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.000924] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.000924] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.000924] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port d3aef1bd-4b76-4116-9d04-ac11bfa3f479 not found, creating... [ 618.001202] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.001379] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.001511] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.001828] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.002063] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.002445] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.002626] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.002715] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.002966] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.003104] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.003249] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: d3aef1bd-4b76-4116-9d04-ac11bfa3f479 is going to be created. [ 618.027703] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.027916] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.028079] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.029056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.029056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.029056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.113731] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 618.114026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.263560] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.263776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.263776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.264029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.264900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.265071] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.265071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.265251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.265324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.265382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.265433] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be updated. [ 618.314665] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.314899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.314899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.315093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.315233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.325182] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: IN_PROGRESS for 2s [ 618.707029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 618.707216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.707330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.707596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.709136] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.709136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.709136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.709136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.709136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.709136] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.717808] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 618.717994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.718335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.718711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.718937] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.719131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.719277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.719877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.719877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.719877] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.731934] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 618.732246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.732860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.733826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.734076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.734292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.734342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.734532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.734644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.734758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.734862] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.865965] env[65381]: INFO networking_nsxv3.common.synchronization [req-08e11337-1cd4-46cc-aee1-c5125e2a2eaa req-96b96cc5-3303-420d-8e19-2d8bf6d7d219 service nova] Enqueued Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_rules [ 618.866346] env[65381]: INFO networking_nsxv3.common.synchronization [req-08e11337-1cd4-46cc-aee1-c5125e2a2eaa req-96b96cc5-3303-420d-8e19-2d8bf6d7d219 service nova] Enqueued Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_members [ 618.866346] env[65381]: INFO networking_nsxv3.common.synchronization [req-08e11337-1cd4-46cc-aee1-c5125e2a2eaa req-96b96cc5-3303-420d-8e19-2d8bf6d7d219 service nova] Enqueued Resource ID: d3aef1bd-4b76-4116-9d04-ac11bfa3f479 with Priority: HIGHEST for action port [ 618.868976] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_rules [ 618.868976] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_members [ 618.868976] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3aef1bd-4b76-4116-9d04-ac11bfa3f479 with Priority: HIGHEST for action port [ 618.868976] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.868976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.868976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.868976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.868976] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.869436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.869513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.869612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.869834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.870016] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.870122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.870248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.870365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.870448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.870540] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.871426] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.871552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.871600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.871753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.871832] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3aef1bd-4b76-4116-9d04-ac11bfa3f479',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.059113] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 619.059381] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 619.059631] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_members [ 619.060812] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 619.061756] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 619.061756] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_members [ 619.062443] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.062874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.063271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.063461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.063787] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-925daac4-0253-45dd-b73d-5ba84bd9c0d5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.064021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.064163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.064523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.064709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.066033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.066033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.066033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.066033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.066033] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.133634] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 619.133964] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 619.134206] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_rules [ 619.134462] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_members [ 619.134735] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_rules [ 619.134907] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 619.135183] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbb26af8-2dec-47f1-a974-9a615d82e7a5 req-30031809-ee9e-49b6-bfa8-9f568a3f393a tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: a9e2a5ae-54bf-4938-8789-946422d12e8c with Priority: HIGHEST for action port [ 619.136357] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 619.136465] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_rules [ 619.136601] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 619.136807] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9e2a5ae-54bf-4938-8789-946422d12e8c with Priority: HIGHEST for action port [ 619.137138] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_rules [ 619.137890] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 619.137890] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_members [ 619.137890] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.138125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.138233] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.138476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.138596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.138951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.139070] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.140176] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.140176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.140446] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9e2a5ae-54bf-4938-8789-946422d12e8c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.140446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.140586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.140742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.140923] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9e2a5ae-54bf-4938-8789-946422d12e8c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.143648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.143648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.143648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.143648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.143648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-925daac4-0253-45dd-b73d-5ba84bd9c0d5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.143648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.212027] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.221969] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.239256] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.239256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.239396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.239807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.240029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.240291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.240291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.241085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.241085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.241085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.241305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.241500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.241693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.242019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.242319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.242479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.242545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.242718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.242798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.242890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.243013] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.345085] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 619.345301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.345431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.345865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.346151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.346371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.346371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.346512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.346617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.346692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.346776] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.373851] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.374139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.374199] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.376957] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3aef1bd-4b76-4116-9d04-ac11bfa3f479 with status ACTIVE [ 619.377181] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.377304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.377370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.377582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.377699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.377845] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.378061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.378061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.378187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.378234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.378398] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.378494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.378555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.378701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.378762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.378865] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3aef1bd-4b76-4116-9d04-ac11bfa3f479 is going to be updated. [ 619.406237] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.406449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.406449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.406772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.406926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.407255] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3aef1bd-4b76-4116-9d04-ac11bfa3f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.453517] env[65381]: INFO networking_nsxv3.common.synchronization [req-1058b705-a070-4fa5-9774-8a71a462ba53 req-7ecb52df-9875-48a2-8fd7-c1734c5a9382 tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 619.453517] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 619.454301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.454441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.455047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.455047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.455047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.455047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.455265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.455344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.455980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.455980] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.569301] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.644335] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-925daac4-0253-45dd-b73d-5ba84bd9c0d5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.644335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.644335] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9e2a5ae-54bf-4938-8789-946422d12e8c with status ACTIVE [ 619.644535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.644535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.644627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.644812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.644926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.645094] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.645644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.645862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.646294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.646294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.646656] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.646876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.646991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.647269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.647353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.647508] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9e2a5ae-54bf-4938-8789-946422d12e8c is going to be updated. [ 619.673812] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.673812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.673812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.673812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.673812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.674030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9e2a5ae-54bf-4938-8789-946422d12e8c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.715855] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.724381] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.745925] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46372329-aee9-4feb-9469-adefbb727cb5: rpc.has_security_group_logging(os_id): False [ 619.765742] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.765897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.765990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.766202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.766284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.766474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.767233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.767233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.767233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.767233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.767233] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.767233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.767233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.767529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.767529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.767593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.767669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.767743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.767940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.768253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.768433] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be created. [ 619.853120] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.872446] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.872799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.872799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.872927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.873054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.875953] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.891242] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: IN_PROGRESS for 2s [ 619.912152] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.912379] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.912523] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.912725] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.912991] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.913175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.913288] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.913504] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.913644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.913971] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.914117] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.914117] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.914271] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.914348] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.914437] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.914536] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.942991] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.943218] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.943370] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.943472] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.943899] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-2e6d544e-2930-45c0-8f96-dbf5682baf39 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.944145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.944145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.944470] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.944603] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6d544e-2930-45c0-8f96-dbf5682baf39',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.959350] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.073184] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.219538] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.219840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.219970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.220879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.221110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.221489] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be updated. [ 620.228202] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.228456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.228456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.228780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.228780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.228947] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 620.270248] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.270513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.270584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.270807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.271017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.273577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.273712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.273871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.274241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.274443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.285075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: IN_PROGRESS for 2s [ 620.285853] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 620.337729] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 620.338028] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 deletion is rescheduled due to dependency. [ 620.338491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.355401] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a89d4d84-7cb2-4c08-be05-40a006a7aba6: rpc.has_security_group_logging(os_id): False [ 620.372669] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.372997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.372997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.373511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.373511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.373511] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.373726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.373726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.373822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.373914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.374011] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be created. [ 620.378912] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.379080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.379142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.379347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.379436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.379659] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 is going to be created. [ 620.427631] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.427976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.427976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.428238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.428315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.448225] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.448473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.448614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.448920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.449087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.449254] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 2e6d544e-2930-45c0-8f96-dbf5682baf39 not found, creating... [ 620.449529] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.449760] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.449941] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.450195] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.450374] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.450773] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.450979] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.451516] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.451821] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.452021] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.452203] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 2e6d544e-2930-45c0-8f96-dbf5682baf39 is going to be created. [ 620.462662] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.471676] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 in Status: UNINITIALIZED for 2s [ 620.500935] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.501245] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.501432] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.501838] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.502182] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.502501] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.514215] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.514431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.514431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.514676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.514864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.543391] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 620.576226] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.576371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.576648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.576825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.576914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.577087] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 is going to be created. [ 620.633514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.633674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.633726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.633967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.634162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.679967] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: UNINITIALIZED for 2s [ 620.965627] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.966087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.966087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.966087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.966203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.966820] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 620.997619] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.997987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.997987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.998256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.998256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.009046] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 621.250653] env[65381]: INFO networking_nsxv3.common.synchronization [req-1058b705-a070-4fa5-9774-8a71a462ba53 req-af803821-649c-44da-acca-1a03e603f2a1 service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 621.250908] env[65381]: INFO networking_nsxv3.common.synchronization [req-1058b705-a070-4fa5-9774-8a71a462ba53 req-af803821-649c-44da-acca-1a03e603f2a1 service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 621.251109] env[65381]: INFO networking_nsxv3.common.synchronization [req-1058b705-a070-4fa5-9774-8a71a462ba53 req-af803821-649c-44da-acca-1a03e603f2a1 service nova] Enqueued Resource ID: 2e6d544e-2930-45c0-8f96-dbf5682baf39 with Priority: HIGHEST for action port [ 621.251973] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 621.252133] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 621.252538] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e6d544e-2930-45c0-8f96-dbf5682baf39 with Priority: HIGHEST for action port [ 621.252627] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.252934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.252934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.255024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.255024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.258084] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.259415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.259415] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e6d544e-2930-45c0-8f96-dbf5682baf39 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.259415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.259415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.259617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.259656] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e6d544e-2930-45c0-8f96-dbf5682baf39',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.747922] env[65381]: INFO networking_nsxv3.common.synchronization [req-0281abc0-8cde-4ede-a8b0-c176560e584b req-95db43a7-9622-423b-bd93-6ac7e08c9ea0 tempest-ServerDiagnosticsNegativeTest-1221916531 tempest-ServerDiagnosticsNegativeTest-1221916531-project-member] Enqueued Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_members [ 621.748563] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGHEST for action security_group_members [ 621.753353] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.753649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.754024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.754337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.754612] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.754775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.754938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.755279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.755279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.755438] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.765247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.765247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.765247] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e6d544e-2930-45c0-8f96-dbf5682baf39 with status ACTIVE [ 621.765247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.765466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.765714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.766478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.766478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.766478] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.766478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.766478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.766968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.766968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.767201] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.767281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.767625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.767625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.767822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.768015] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e6d544e-2930-45c0-8f96-dbf5682baf39 is going to be updated. [ 621.821922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.822228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.822228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.822374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.822511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.822694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e6d544e-2930-45c0-8f96-dbf5682baf39" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.910072] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 621.910615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.258540] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.259112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.259112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.259112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.259318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.259393] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.259474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.259532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.259691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.259768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.259857] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2380b72e-771a-447f-bf96-4a7738880121 is going to be updated. [ 622.294175] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.294488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.294488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.294647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.294727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.296793] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 622.296938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.299385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.299521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.299718] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.299850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.299918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.300757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.301784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.301784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.301784] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.303424] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2380b72e-771a-447f-bf96-4a7738880121 in Status: IN_PROGRESS for 2s [ 622.304200] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 622.304404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.304584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.305341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.306063] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.306262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.306336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.306558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.306663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.306758] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.307707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.307911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.308156] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.308299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.308430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.308543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.308660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.308791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.308923] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.310576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.310856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.310979] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.311117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.311821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.311821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.311821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.311821] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.485950] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 in Status: SUCCESS [ 622.487708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.488024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.488517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.488517] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.488517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.488517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.488753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.488753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.488814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.489566] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.560322] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 622.561038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.583578] env[65381]: INFO networking_nsxv3.common.synchronization [req-a81ce640-4aca-42b6-8c56-450c38775396 req-2d6479aa-9d33-4e08-bed6-3cc18dea3351 tempest-ServersWithSpecificFlavorTestJSON-513012973 tempest-ServersWithSpecificFlavorTestJSON-513012973-project-member] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 622.586828] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 622.586828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.586828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.586828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.586828] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.690889] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: SUCCESS [ 622.691156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.691739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.691980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.692199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.692379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.692488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.692715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.694556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.694556] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.811206] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.816039] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.816039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.816039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.816039] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.991223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.991648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.991648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.993408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.993628] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.993757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.993826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.994052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.994233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.994233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.994396] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.994493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.994558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.994764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.994840] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.994939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.994991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.995148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.995228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.995310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.995470] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.021469] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 623.021469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.021741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.021827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.022029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.022156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.022221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.022396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.022480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.022575] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.091266] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.091789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.091914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.092162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.092262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.092478] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.092577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.092671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.092866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.093072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.093072] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e already deleted. [ 623.093194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.196778] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.255531] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-763 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.255757] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.255888] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.256798] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.256798] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.256798] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.256798] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.257075] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.257176] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.257379] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.257486] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.257590] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.257746] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.257792] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.257984] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.257984] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.285805] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.285805] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.285805] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.285805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.285805] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-d668d65c-fe98-4b96-97c7-0f8b7a909b19 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.285805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.285805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.285805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.285805] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d668d65c-fe98-4b96-97c7-0f8b7a909b19',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.314639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 993d6955-5d35-45d8-9907-eba6ec8a9076: rpc.has_security_group_logging(os_id): False [ 623.315915] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.318153] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.339011] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.339011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.339011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.339309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.339309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.339696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.339696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.339994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.339994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.339994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.340204] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be created. [ 623.396918] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.397095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.397197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.397381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.397618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.412932] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: IN_PROGRESS for 2s [ 623.498020] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e0f1f6c-cf36-4109-b367-60396c3e8160: rpc.has_security_group_logging(os_id): False [ 623.528544] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.537949] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.538187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.538187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.538759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.538986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.539247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.539373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.539424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.539636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.539720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.539975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.540466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.540466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.540728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.540807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.540994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.541148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.541206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.541372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.541494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.541595] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 is going to be created. [ 623.611874] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.612132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.612132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.612744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.612744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.627165] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 in Status: IN_PROGRESS for 2s [ 623.703715] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.789063] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.789349] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.789503] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.790460] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.790460] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.790460] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port d668d65c-fe98-4b96-97c7-0f8b7a909b19 not found, creating... [ 623.790872] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.791094] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.791217] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.791452] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.791588] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.791979] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.792060] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.792195] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.792440] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.792496] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.792672] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: d668d65c-fe98-4b96-97c7-0f8b7a909b19 is going to be created. [ 623.819998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.820231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.820301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.820513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.820603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.820828] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be updated. [ 623.823040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.823207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.823395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.823663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.823895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.824031] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 623.826296] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.826473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.826589] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.826825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.827047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.827260] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.859862] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.860029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.860104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.860344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.860486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.862636] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.862766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.862766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.862933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.863131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.881725] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 623.887780] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: IN_PROGRESS for 2s [ 624.031366] env[65381]: INFO networking_nsxv3.common.synchronization [req-1f5a4986-61c8-4d15-aa65-e43cabbbe641 req-31695538-1aee-4e50-adec-348596a895f5 tempest-SecurityGroupRulesNegativeTestJSON-515630460 tempest-SecurityGroupRulesNegativeTestJSON-515630460-project-member] Enqueued Resource ID: c68da681-6ebb-4794-8540-55eddad18a1e with Priority: HIGHEST for action security_group_rules [ 624.031538] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.032762] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c68da681-6ebb-4794-8540-55eddad18a1e with Priority: HIGHEST for action security_group_rules [ 624.033312] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c68da681-6ebb-4794-8540-55eddad18a1e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.033526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.033592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.033799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.033882] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c68da681-6ebb-4794-8540-55eddad18a1e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.208191] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.208443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.208443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.208655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.208805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.208805] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 is going to be updated. [ 624.252333] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.252487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.252559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.252777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.252928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.265524] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: IN_PROGRESS for 2s [ 624.315228] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2380b72e-771a-447f-bf96-4a7738880121 in Status: SUCCESS [ 624.316453] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2380b72e-771a-447f-bf96-4a7738880121 deletion is rescheduled due to dependency. [ 624.316453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.535259] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.535259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.535259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.535513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.535771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.535771] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 624.556295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.556438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.556511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.556727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.558980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.558980] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c68da681-6ebb-4794-8540-55eddad18a1e already deleted. [ 624.558980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c68da681-6ebb-4794-8540-55eddad18a1e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.581414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.581414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.581414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.581414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.581414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.592320] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 624.609288] env[65381]: INFO networking_nsxv3.common.synchronization [req-a81ce640-4aca-42b6-8c56-450c38775396 req-5aeaeef1-e396-4756-b53e-e9df43834fe6 service nova] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 624.609496] env[65381]: INFO networking_nsxv3.common.synchronization [req-a81ce640-4aca-42b6-8c56-450c38775396 req-5aeaeef1-e396-4756-b53e-e9df43834fe6 service nova] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 624.609625] env[65381]: INFO networking_nsxv3.common.synchronization [req-a81ce640-4aca-42b6-8c56-450c38775396 req-5aeaeef1-e396-4756-b53e-e9df43834fe6 service nova] Enqueued Resource ID: d668d65c-fe98-4b96-97c7-0f8b7a909b19 with Priority: HIGHEST for action port [ 624.610124] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 624.610264] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 624.610410] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d668d65c-fe98-4b96-97c7-0f8b7a909b19 with Priority: HIGHEST for action port [ 624.610649] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.610884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.610924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.611168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.611247] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.612990] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.612990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.612990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.612990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.615436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.615566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.615646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.615806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.615897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.615997] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.616864] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d668d65c-fe98-4b96-97c7-0f8b7a909b19 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.616988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.617072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.617232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.617328] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d668d65c-fe98-4b96-97c7-0f8b7a909b19',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.096400] env[65381]: INFO networking_nsxv3.common.synchronization [req-7b16a341-347f-46aa-b11d-1c75dfad7beb req-b7230b08-c37d-4b17-8a0c-ba1cad0810a5 tempest-ListImageFiltersTestJSON-1885631896 tempest-ListImageFiltersTestJSON-1885631896-project-member] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 625.096932] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 625.097704] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.097704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.097704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.097704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.097972] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.097972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.097972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.098175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.098321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.098423] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.118575] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.119737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.119865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.120073] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d668d65c-fe98-4b96-97c7-0f8b7a909b19 with status ACTIVE [ 625.120300] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.120441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.120523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.122290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.122290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.122290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.122798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d668d65c-fe98-4b96-97c7-0f8b7a909b19 is going to be updated. [ 625.150463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.150638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.150688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.150999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.151192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.151427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d668d65c-fe98-4b96-97c7-0f8b7a909b19" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.433307] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 625.433801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.434048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.434193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.434297] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.602059] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.606049] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.606332] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.606579] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.606952] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.607813] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.607813] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.607813] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.608085] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.608354] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.608766] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.608836] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.608939] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.609123] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.609307] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.609467] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.610296] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.624358] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.633812] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.634220] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.634430] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.635179] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.635179] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.635179] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.635518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.635518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.635771] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff8bd1c-52d0-499e-9a24-ed122ac9d38d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.640518] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 in Status: SUCCESS [ 625.641263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.893437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 625.893809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.894063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.894390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.894776] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.894885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.895052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.895278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.895394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.895535] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.906690] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 625.907111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.907805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.908264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.908559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.908751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.908873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.909151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.909290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.909454] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.938060] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.938146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.112301] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.126723] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.126882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.126955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.127193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.127282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.127380] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be created. [ 626.138865] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.139212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.139467] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.139607] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.139878] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.139989] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 1ff8bd1c-52d0-499e-9a24-ed122ac9d38d not found, creating... [ 626.140178] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.140334] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.140458] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.140840] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.141022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.141394] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.141516] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.141892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.142179] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.142346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.142491] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 1ff8bd1c-52d0-499e-9a24-ed122ac9d38d is going to be created. [ 626.156941] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.157146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.157146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.157395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.157497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.167359] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.167501] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.167789] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.167947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.168141] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.168401] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.170048] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: UNINITIALIZED for 2s [ 626.291481] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: SUCCESS [ 626.291731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.291907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.292150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.292342] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.292462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.292528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.292677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.292761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.292991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.292991] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.398260] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.412246] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.602563] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 626.602834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.603084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.603314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.603503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.603883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.603883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.603883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.603883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.604076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.604076] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.614768] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.614923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.614992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.615236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.615322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.615461] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be updated. [ 626.643330] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.643556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.643670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.643982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.644218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.656445] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: IN_PROGRESS for 2s [ 626.796104] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.900783] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.903651] env[65381]: INFO networking_nsxv3.common.synchronization [req-7b16a341-347f-46aa-b11d-1c75dfad7beb req-01d3f668-0585-4226-b5d5-75f9c732a7c9 service nova] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_rules [ 626.903881] env[65381]: INFO networking_nsxv3.common.synchronization [req-7b16a341-347f-46aa-b11d-1c75dfad7beb req-01d3f668-0585-4226-b5d5-75f9c732a7c9 service nova] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 626.904311] env[65381]: INFO networking_nsxv3.common.synchronization [req-7b16a341-347f-46aa-b11d-1c75dfad7beb req-01d3f668-0585-4226-b5d5-75f9c732a7c9 service nova] Enqueued Resource ID: 1ff8bd1c-52d0-499e-9a24-ed122ac9d38d with Priority: HIGHEST for action port [ 626.904827] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_rules [ 626.906038] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 626.906038] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff8bd1c-52d0-499e-9a24-ed122ac9d38d with Priority: HIGHEST for action port [ 626.906038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.906038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.906038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.906038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.906038] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.907438] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.907561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.908503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.908503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.908503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.908503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.908824] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff8bd1c-52d0-499e-9a24-ed122ac9d38d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.914806] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.107303] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.108188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.108188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.108188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.108188] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.108188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.108188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.108471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.108471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.108543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.109758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.109758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.109758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.109758] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.299263] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 925daac4-0253-45dd-b73d-5ba84bd9c0d5: rpc.has_security_group_logging(os_id): False [ 627.322314] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.326325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.326677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.326677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.327543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.327543] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.327543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.327543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.327543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.328137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.328137] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 is going to be created. [ 627.388238] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.388238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.388238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.388238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.388238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.400957] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: IN_PROGRESS for 2s [ 627.405984] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.405984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.406157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.406388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.406469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.406536] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 627.411030] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ff8bd1c-52d0-499e-9a24-ed122ac9d38d with status ACTIVE [ 627.411469] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.411469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.411469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.411719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.411789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.411995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.412174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.412232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.412405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.412525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.413258] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.413258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.413258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.413258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.413542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.413542] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ff8bd1c-52d0-499e-9a24-ed122ac9d38d is going to be updated. [ 627.415680] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.415680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.416556] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.417018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.417018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.420053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.420053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.420053] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be updated. [ 627.465225] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.465431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.465499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.465726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.465868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.466041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff8bd1c-52d0-499e-9a24-ed122ac9d38d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.469307] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.469307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.469466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.469661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.469824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.473710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.473906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.474243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.474327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.474504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.495786] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 627.497977] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: IN_PROGRESS for 2s [ 627.612511] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca1b5748-90c1-473a-ab4f-767cc4ab05d7: rpc.has_security_group_logging(os_id): False [ 627.646673] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.647038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.647038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.647447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.647447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.647771] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.647908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.648084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.648250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.648355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.648591] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.648918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.648918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.649077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.649848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.650600] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.650600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.650600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.650882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.652518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.652518] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 627.751476] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.751819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.751819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.752117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.752348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.769161] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 628.180638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 628.180943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.181149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.181398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.181673] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.181806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.181876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.182062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.182153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182328] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.667731] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 628.668031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.668143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.668399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.669026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.669026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.669026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.669026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.669359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.669359] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.684663] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.172234] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.186599] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40be60f5-b915-4038-8a92-b31ab9bbba3e: rpc.has_security_group_logging(os_id): False [ 629.213480] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.213711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.213711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.214172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.214172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.214322] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.214454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.214522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.214688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.214775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.214858] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be created. [ 629.273023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.273367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.273469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.273723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.274072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.285882] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: IN_PROGRESS for 2s [ 629.413997] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: SUCCESS [ 629.414242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.512308] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 629.512308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.512308] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 629.512308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.514696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.514696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.514696] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.515520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.515520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.515687] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.515796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.515859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.515999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.516096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.516176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.516351] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.516452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.516515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.516662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.516805] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.516900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.516958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.518554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.518633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.518806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.518923] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.677584] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.787979] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 629.787979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.023988] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.023988] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48eacb50-df32-446c-947a-a00fbf576caa: rpc.has_security_group_logging(os_id): False [ 630.047653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.048156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.048379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.048693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.048888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.049305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.049542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.049696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.049953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.050146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.050475] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.050690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.050866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.051123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.051297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.051580] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.051836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.052050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.052300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.052469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.052663] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 630.128465] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.128912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.129986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.130264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.130495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.149270] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 630.181223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.181516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.181516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.181694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.181779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.181885] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be updated. [ 630.217961] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.218247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.218247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.222132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.222132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.237204] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: IN_PROGRESS for 2s [ 630.525452] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 993d6955-5d35-45d8-9907-eba6ec8a9076: rpc.has_security_group_logging(os_id): False [ 630.550439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.551910] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.551910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.552350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.552350] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be updated. [ 630.614632] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.614632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.614632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.614632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.615036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.634505] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: IN_PROGRESS for 2s [ 631.256081] env[65381]: INFO networking_nsxv3.common.synchronization [req-b7507487-c890-4da2-8b9e-acc336c13370 req-37d744f4-dc45-4b17-9077-01fd2b66bc3c tempest-ImagesNegativeTestJSON-1506270380 tempest-ImagesNegativeTestJSON-1506270380-project-member] Enqueued Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_members [ 631.257062] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_members [ 631.257968] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.258172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.258258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.258560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.258761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.258901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.258960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.259197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.259293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.259392] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.305177] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 631.305411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.766327] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.766496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.766575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.766797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.766910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.767100] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.767242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.767291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.767417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.767494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.767596] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf already deleted. [ 631.767681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.022739] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.022739] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-568" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.023129] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-568" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.023231] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-568" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.023502] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.023665] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.023778] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.024144] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.024259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.025969] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.025969] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.025969] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.025969] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.025969] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.025969] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.025969] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.053602] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.053903] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.054168] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.054683] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-568" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.054983] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-29b00fc1-e1fe-44dd-a310-2938aab8abc3 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.055400] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.055589] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.056056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.056272] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29b00fc1-e1fe-44dd-a310-2938aab8abc3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.166903] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 632.167205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.167400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.167632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.167722] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.248365] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 632.248591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.248885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.249167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.249364] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.249485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.249550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.249711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.249790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.249897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.249991] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.549614] env[65381]: INFO networking_nsxv3.common.synchronization [None req-9ab0e388-1004-49d8-b46e-93483827f1c4 None None] Enqueued Resource ID: c2a9fb6f-74fb-48e5-962c-77cc25f7f28b with Priority: HIGHEST for action port [ 632.551038] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2a9fb6f-74fb-48e5-962c-77cc25f7f28b with Priority: HIGHEST for action port [ 632.551778] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2a9fb6f-74fb-48e5-962c-77cc25f7f28b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.552266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2a9fb6f-74fb-48e5-962c-77cc25f7f28b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.552460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2a9fb6f-74fb-48e5-962c-77cc25f7f28b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.553051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2a9fb6f-74fb-48e5-962c-77cc25f7f28b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.553209] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2a9fb6f-74fb-48e5-962c-77cc25f7f28b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.560986] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.561325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.562170] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.562170] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.562170] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.562170] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 29b00fc1-e1fe-44dd-a310-2938aab8abc3 not found, creating... [ 632.562498] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.562946] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.562946] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.563087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.563341] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.563583] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.564057] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.564057] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.564487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.564487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.564644] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 29b00fc1-e1fe-44dd-a310-2938aab8abc3 is going to be created. [ 632.590884] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.590884] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.591142] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.591254] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.591670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.591980] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.654665] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 632.654665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.670126] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.670311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.670373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.670590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.670774] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.671155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.671155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.671155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.671417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.671417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.671417] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.752928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.753113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.753219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.753432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.753636] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.753843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.753843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.754052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.754533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.754652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.754882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.755095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.755167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.755374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.755520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.755623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.755696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.755966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.755966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.756117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.756117] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.055862] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2a9fb6f-74fb-48e5-962c-77cc25f7f28b [ 633.055862] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.056359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.056359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.056557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.057147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.057147] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2a9fb6f-74fb-48e5-962c-77cc25f7f28b already deleted. [ 633.057147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2a9fb6f-74fb-48e5-962c-77cc25f7f28b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.174198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.174407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.174456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.175554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.175554] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.175554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.175554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.176205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.176313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.176417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.176593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.176695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.176739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.176882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.177038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.177131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.177203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.177398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.177475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.177602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.177661] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.260029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46372329-aee9-4feb-9469-adefbb727cb5: rpc.has_security_group_logging(os_id): False [ 633.280065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.280065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.280280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.280323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.280406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.280643] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.280708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.280746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.280986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.280986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.286021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.286021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.286021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.286021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be updated. [ 633.358896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.359088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.359175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.359387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.359601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.381411] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: IN_PROGRESS for 2s [ 633.414540] env[65381]: INFO networking_nsxv3.common.synchronization [req-b7507487-c890-4da2-8b9e-acc336c13370 req-6d315782-948f-4909-9094-267579b63085 service nova] Enqueued Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_rules [ 633.414694] env[65381]: INFO networking_nsxv3.common.synchronization [req-b7507487-c890-4da2-8b9e-acc336c13370 req-6d315782-948f-4909-9094-267579b63085 service nova] Enqueued Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_members [ 633.415202] env[65381]: INFO networking_nsxv3.common.synchronization [req-b7507487-c890-4da2-8b9e-acc336c13370 req-6d315782-948f-4909-9094-267579b63085 service nova] Enqueued Resource ID: 29b00fc1-e1fe-44dd-a310-2938aab8abc3 with Priority: HIGHEST for action port [ 633.415482] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_rules [ 633.415961] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_members [ 633.415961] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29b00fc1-e1fe-44dd-a310-2938aab8abc3 with Priority: HIGHEST for action port [ 633.416270] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.416270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.416270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.416486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.416553] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.417527] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.423134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.423134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.423134] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.423134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-29b00fc1-e1fe-44dd-a310-2938aab8abc3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.423560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.423560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.424374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.424374] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29b00fc1-e1fe-44dd-a310-2938aab8abc3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.684674] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48eacb50-df32-446c-947a-a00fbf576caa: rpc.has_security_group_logging(os_id): False [ 633.705172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.705172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.705172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.705172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.705172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.705172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.705840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.707501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.707788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.707939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.708012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.708173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.708291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.710188] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.710188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.710188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.710188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.710188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.710188] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 633.772886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.773087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.773087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.773515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.773586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.801691] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 633.925702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.925938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.926130] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.927071] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29b00fc1-e1fe-44dd-a310-2938aab8abc3 with status ACTIVE [ 633.927299] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.928227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.928340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.928581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.928716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.928975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.929383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.929383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.929383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.930164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.930164] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.930460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.930460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.932818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.932818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.932818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29b00fc1-e1fe-44dd-a310-2938aab8abc3 is going to be updated. [ 633.956811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.958352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.958564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.958813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.958964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.959148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29b00fc1-e1fe-44dd-a310-2938aab8abc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.433994] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.936243] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.936553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.936553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.936672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.936761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.936854] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf is going to be created. [ 634.963089] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.963244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.963316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.963528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.963688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.973628] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf in Status: UNINITIALIZED for 2s [ 635.060452] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1a40ec87-003b-4d1c-8e05-f5d4b97753db None None] Enqueued Resource ID: 2f81baf3-6896-4e8f-a5e9-337dbdc427d4 with Priority: HIGHEST for action port [ 635.061074] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f81baf3-6896-4e8f-a5e9-337dbdc427d4 with Priority: HIGHEST for action port [ 635.061405] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f81baf3-6896-4e8f-a5e9-337dbdc427d4 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.061532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f81baf3-6896-4e8f-a5e9-337dbdc427d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.061600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f81baf3-6896-4e8f-a5e9-337dbdc427d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.061857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f81baf3-6896-4e8f-a5e9-337dbdc427d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.061962] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f81baf3-6896-4e8f-a5e9-337dbdc427d4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.398059] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 635.398346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.568802] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f81baf3-6896-4e8f-a5e9-337dbdc427d4 [ 635.569869] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.569869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.569869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.569869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.569869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.569869] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f81baf3-6896-4e8f-a5e9-337dbdc427d4 already deleted. [ 635.569869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f81baf3-6896-4e8f-a5e9-337dbdc427d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.820146] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 635.820416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.110487] env[65381]: INFO networking_nsxv3.common.synchronization [None req-afa20d35-f42a-404e-9ede-76ecc6af73b0 None None] Enqueued Resource ID: 6add30aa-485b-4d61-9799-07ca57627f54 with Priority: HIGHEST for action port [ 636.111321] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6add30aa-485b-4d61-9799-07ca57627f54 with Priority: HIGHEST for action port [ 636.111389] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6add30aa-485b-4d61-9799-07ca57627f54 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.111513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6add30aa-485b-4d61-9799-07ca57627f54" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.111574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6add30aa-485b-4d61-9799-07ca57627f54" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.111832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6add30aa-485b-4d61-9799-07ca57627f54" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.111918] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6add30aa-485b-4d61-9799-07ca57627f54',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.479586] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b92c8bf4-2d3e-43b9-8a9e-0e59ae22abc2 None None] Enqueued Resource ID: 5d614c70-93b9-47f0-a422-8e8caf577e1d with Priority: HIGHEST for action port [ 636.480360] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d614c70-93b9-47f0-a422-8e8caf577e1d with Priority: HIGHEST for action port [ 636.480669] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d614c70-93b9-47f0-a422-8e8caf577e1d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.480823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d614c70-93b9-47f0-a422-8e8caf577e1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.480958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d614c70-93b9-47f0-a422-8e8caf577e1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.481235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d614c70-93b9-47f0-a422-8e8caf577e1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.481326] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d614c70-93b9-47f0-a422-8e8caf577e1d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.617944] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6add30aa-485b-4d61-9799-07ca57627f54 [ 636.618845] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.618845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.618845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.618845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.618845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.618845] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6add30aa-485b-4d61-9799-07ca57627f54 already deleted. [ 636.619159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6add30aa-485b-4d61-9799-07ca57627f54" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.986234] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d614c70-93b9-47f0-a422-8e8caf577e1d [ 636.986602] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.986807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.986925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.987262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.987396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.987531] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d614c70-93b9-47f0-a422-8e8caf577e1d already deleted. [ 636.987642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d614c70-93b9-47f0-a422-8e8caf577e1d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.988783] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf in Status: SUCCESS [ 636.988977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.990294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.990294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.990294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.990294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.990294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.990754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.990955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.991010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.991116] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.493729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.494046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.494119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.494346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.494509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.494610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.494672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.494857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.494903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.494979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.495899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.495899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.495899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.495899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.495899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.495899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.495899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.499784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.499784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.499784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.499784] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.003460] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf: rpc.has_security_group_logging(os_id): False [ 638.026230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.026230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.026230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.026230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.026867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.026867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.026867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.026867] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.026867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.026867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.027098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.027098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.027165] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf is going to be created. [ 638.095799] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.095799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.095799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.095799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.095799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.112043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf in Status: IN_PROGRESS for 2s [ 639.226168] env[65381]: INFO networking_nsxv3.common.synchronization [None req-f9881c8d-fada-4952-a510-3c81f07fd7c6 None None] Enqueued Resource ID: dcfd8034-4852-471b-bf33-a9a99cadc6e6 with Priority: HIGHEST for action port [ 639.226947] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcfd8034-4852-471b-bf33-a9a99cadc6e6 with Priority: HIGHEST for action port [ 639.227771] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcfd8034-4852-471b-bf33-a9a99cadc6e6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.227972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcfd8034-4852-471b-bf33-a9a99cadc6e6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.227972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcfd8034-4852-471b-bf33-a9a99cadc6e6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.228344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcfd8034-4852-471b-bf33-a9a99cadc6e6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.228477] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcfd8034-4852-471b-bf33-a9a99cadc6e6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.731420] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcfd8034-4852-471b-bf33-a9a99cadc6e6 [ 639.732223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.735177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.735177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.735177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.735371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.735371] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcfd8034-4852-471b-bf33-a9a99cadc6e6 already deleted. [ 639.735453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcfd8034-4852-471b-bf33-a9a99cadc6e6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.126923] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf in Status: SUCCESS [ 640.127186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.726024] env[65381]: INFO networking_nsxv3.common.synchronization [req-e2505dc3-3ec9-4e62-938a-ecf77f8f4d1d req-ef3ce837-3d8b-46f0-93b4-6131fd6f467e tempest-TenantUsagesTestJSON-754845505 tempest-TenantUsagesTestJSON-754845505-project-member] Enqueued Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_members [ 640.726437] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_members [ 640.726746] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.726873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.726943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.727230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.727393] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.727600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.727654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.727824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.728155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.728155] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.228594] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.228954] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.229148] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.229515] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.229903] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.230082] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.230292] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.230547] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.230773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.231107] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.231284] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.231460] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.231624] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.231749] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.231850] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.232044] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.233570] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.233688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.233749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.233908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.233993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.234266] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.234405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.234565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.234714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.234806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.234896] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 already deleted. [ 641.234979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.259329] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.259739] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.260087] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.260377] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.260828] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-267bb003-8794-4bf9-b9c6-5126bde65eb5 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.261103] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.261239] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.261587] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.261716] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('267bb003-8794-4bf9-b9c6-5126bde65eb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.765775] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.766225] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.766225] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.766592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.766592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.766766] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 267bb003-8794-4bf9-b9c6-5126bde65eb5 not found, creating... [ 641.767141] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.767269] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.767533] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.767672] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.767831] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.768266] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.769246] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.769377] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.769616] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.769755] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.770067] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 267bb003-8794-4bf9-b9c6-5126bde65eb5 is going to be created. [ 641.793220] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.793405] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.793454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.793721] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.793921] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.794164] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.130574] env[65381]: INFO networking_nsxv3.common.synchronization [None req-abf795eb-91e2-4743-a8f6-aa340cc32478 None None] Enqueued Resource ID: 525d9daf-51e7-4ee3-909c-26c6420346d9 with Priority: HIGHEST for action port [ 642.130982] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 525d9daf-51e7-4ee3-909c-26c6420346d9 with Priority: HIGHEST for action port [ 642.131334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-525d9daf-51e7-4ee3-909c-26c6420346d9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.131484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-525d9daf-51e7-4ee3-909c-26c6420346d9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.131571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-525d9daf-51e7-4ee3-909c-26c6420346d9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.131883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-525d9daf-51e7-4ee3-909c-26c6420346d9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.131977] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('525d9daf-51e7-4ee3-909c-26c6420346d9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.254997] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c93b222a-d5e8-4e97-8036-bfa6150648c9 None None] Enqueued Resource ID: 437ba451-b9bb-436e-9a4b-857469935295 with Priority: HIGHEST for action port [ 642.256753] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437ba451-b9bb-436e-9a4b-857469935295 with Priority: HIGHEST for action port [ 642.256753] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-437ba451-b9bb-436e-9a4b-857469935295 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.256753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-437ba451-b9bb-436e-9a4b-857469935295" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.256753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-437ba451-b9bb-436e-9a4b-857469935295" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.257276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-437ba451-b9bb-436e-9a4b-857469935295" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.257463] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437ba451-b9bb-436e-9a4b-857469935295',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.503170] env[65381]: INFO networking_nsxv3.common.synchronization [req-e2505dc3-3ec9-4e62-938a-ecf77f8f4d1d req-fcf4f4bd-3f3a-4b1f-ae32-d186bd61c79a service nova] Enqueued Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_rules [ 642.503372] env[65381]: INFO networking_nsxv3.common.synchronization [req-e2505dc3-3ec9-4e62-938a-ecf77f8f4d1d req-fcf4f4bd-3f3a-4b1f-ae32-d186bd61c79a service nova] Enqueued Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_members [ 642.503853] env[65381]: INFO networking_nsxv3.common.synchronization [req-e2505dc3-3ec9-4e62-938a-ecf77f8f4d1d req-fcf4f4bd-3f3a-4b1f-ae32-d186bd61c79a service nova] Enqueued Resource ID: 267bb003-8794-4bf9-b9c6-5126bde65eb5 with Priority: HIGHEST for action port [ 642.504253] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_rules [ 642.504385] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_members [ 642.505162] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 267bb003-8794-4bf9-b9c6-5126bde65eb5 with Priority: HIGHEST for action port [ 642.505162] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.505162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.505162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.505395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.505395] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.506273] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.506475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.506475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.506838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.506999] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.507106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.507445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.507445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.507445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.507739] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.510870] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-267bb003-8794-4bf9-b9c6-5126bde65eb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.511029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.511085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.511259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.511346] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('267bb003-8794-4bf9-b9c6-5126bde65eb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.635077] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 525d9daf-51e7-4ee3-909c-26c6420346d9 [ 642.635270] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.635270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.635528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.635573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.635912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.635912] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:525d9daf-51e7-4ee3-909c-26c6420346d9 already deleted. [ 642.635912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-525d9daf-51e7-4ee3-909c-26c6420346d9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.762024] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 437ba451-b9bb-436e-9a4b-857469935295 [ 642.762024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.762024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.762024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.762024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.762320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.762320] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:437ba451-b9bb-436e-9a4b-857469935295 already deleted. [ 642.762320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-437ba451-b9bb-436e-9a4b-857469935295" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.018290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.018290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.018290] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.018290] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 267bb003-8794-4bf9-b9c6-5126bde65eb5 with status ACTIVE [ 643.018290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.018290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.018290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.018981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.019058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.019236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.019341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.019439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.019682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.019682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.019820] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.019960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.020020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.022962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.023023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.023385] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 267bb003-8794-4bf9-b9c6-5126bde65eb5 is going to be updated. [ 643.035292] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c9ec4883-95e6-4f7e-ad6e-910f059a07fa None None] Enqueued Resource ID: 41864cca-f2c9-4bb4-a806-c0049f4c2630 with Priority: HIGHEST for action port [ 643.038125] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41864cca-f2c9-4bb4-a806-c0049f4c2630 with Priority: HIGHEST for action port [ 643.038781] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-41864cca-f2c9-4bb4-a806-c0049f4c2630 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.038937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41864cca-f2c9-4bb4-a806-c0049f4c2630" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.039067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41864cca-f2c9-4bb4-a806-c0049f4c2630" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.039340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41864cca-f2c9-4bb4-a806-c0049f4c2630" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.039439] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41864cca-f2c9-4bb4-a806-c0049f4c2630',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.049207] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.049358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.049427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.049633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.049769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.050141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-267bb003-8794-4bf9-b9c6-5126bde65eb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.527371] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.543876] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41864cca-f2c9-4bb4-a806-c0049f4c2630 [ 643.543876] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.543876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.543876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.543876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.543876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.543876] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41864cca-f2c9-4bb4-a806-c0049f4c2630 already deleted. [ 643.543876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41864cca-f2c9-4bb4-a806-c0049f4c2630" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.036563] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.036563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.036563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.036563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.036563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.036563] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 is going to be created. [ 644.085181] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.085181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.085181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.085181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.085181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.098607] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 in Status: UNINITIALIZED for 2s [ 644.947478] env[65381]: INFO networking_nsxv3.common.synchronization [None req-47503de2-242f-4d66-8152-9663dd767f59 None None] Enqueued Resource ID: d5d61f39-ce12-4790-8204-0f9559faedaa with Priority: HIGHEST for action port [ 644.948307] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5d61f39-ce12-4790-8204-0f9559faedaa with Priority: HIGHEST for action port [ 644.949549] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5d61f39-ce12-4790-8204-0f9559faedaa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.949710] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5d61f39-ce12-4790-8204-0f9559faedaa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.949805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5d61f39-ce12-4790-8204-0f9559faedaa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.950437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5d61f39-ce12-4790-8204-0f9559faedaa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.950542] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5d61f39-ce12-4790-8204-0f9559faedaa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.453338] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5d61f39-ce12-4790-8204-0f9559faedaa [ 645.453671] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.453751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.453930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.454062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.454137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.454261] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5d61f39-ce12-4790-8204-0f9559faedaa already deleted. [ 645.454380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5d61f39-ce12-4790-8204-0f9559faedaa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.114392] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 in Status: SUCCESS [ 646.115157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.115157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.115157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.115470] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.115470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.115470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.115609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.115646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.115708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.115800] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.436228] env[65381]: INFO networking_nsxv3.common.synchronization [req-cdd20ea0-2380-47a3-b59e-ffc75e059485 req-00a4e01e-f980-44b8-a954-c427c035f830 tempest-ServersNegativeTestMultiTenantJSON-781030771 tempest-ServersNegativeTestMultiTenantJSON-781030771-project-member] Enqueued Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_members [ 646.436986] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_members [ 646.437436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.437652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.437771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.438124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.438359] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.438669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.438669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.438920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.438920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.439113] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.618771] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.619128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.619128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.619359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.619553] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.619700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.619807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.620038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.620176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.620299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.620504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.620628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.621306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.621306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.621306] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.621553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.621553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.621803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.621920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.623082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.623082] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.942534] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.943144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.943144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.943144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.943144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.943548] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.943548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.943548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.943769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.943769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.943769] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 already deleted. [ 646.944032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.116461] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.116650] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-977" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.117158] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-977" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.117750] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-977" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.118386] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.118583] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.118730] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.119046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.119307] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.119516] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.119675] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.119762] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.119914] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.120262] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.120262] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.120402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.125839] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1845664f-8bfa-4c5b-b1d8-5f3082db2137: rpc.has_security_group_logging(os_id): False [ 647.150400] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.150605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.150605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.150803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.150903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.151251] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.153063] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.153063] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.153063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.153063] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 is going to be created. [ 647.161854] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.162062] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.162212] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.163173] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-977" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.163173] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-0ad00af2-307b-4311-8c21-8ad9576f9db4 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.163173] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.163173] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.163465] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.163465] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad00af2-307b-4311-8c21-8ad9576f9db4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.266615] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.266615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.266615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.266615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.266615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.283752] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 in Status: IN_PROGRESS for 2s [ 647.346015] env[65381]: INFO networking_nsxv3.common.synchronization [req-8127e83b-faeb-43cd-8749-b7d52d7063b2 req-be403abf-cf77-4b42-a648-b1044547f385 tempest-ServerDiagnosticsTest-1125027654 tempest-ServerDiagnosticsTest-1125027654-project-member] Enqueued Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_members [ 647.346641] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGHEST for action security_group_members [ 647.351469] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.351736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.351736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.351922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.352170] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.352324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.352445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.352586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.352683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.352792] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.379397] env[65381]: INFO networking_nsxv3.common.synchronization [None req-0d2963d3-406c-4f8b-98c4-c85678ecb79d None None] Enqueued Resource ID: 2f683771-0a12-4ff8-9212-288d2f01beaf with Priority: HIGHEST for action port [ 647.380045] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f683771-0a12-4ff8-9212-288d2f01beaf with Priority: HIGHEST for action port [ 647.380814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f683771-0a12-4ff8-9212-288d2f01beaf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.381072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f683771-0a12-4ff8-9212-288d2f01beaf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.381200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f683771-0a12-4ff8-9212-288d2f01beaf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.381550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f683771-0a12-4ff8-9212-288d2f01beaf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.381550] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f683771-0a12-4ff8-9212-288d2f01beaf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.857030] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.857377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.857377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.857582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.857702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.858687] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.858784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.858860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.859042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.859154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.859453] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 is going to be updated. [ 647.884443] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f683771-0a12-4ff8-9212-288d2f01beaf [ 647.884443] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.884677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.884677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.884880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.884937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.885039] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f683771-0a12-4ff8-9212-288d2f01beaf already deleted. [ 647.885122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f683771-0a12-4ff8-9212-288d2f01beaf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.893494] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.893647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.893691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.893903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.894082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.903812] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 in Status: IN_PROGRESS for 2s [ 648.167653] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.168041] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.168198] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.168773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.168773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.169266] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 0ad00af2-307b-4311-8c21-8ad9576f9db4 not found, creating... [ 648.169428] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.169648] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.169770] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.173205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.173374] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.173738] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.173905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.174009] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.174253] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.174378] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.174515] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 0ad00af2-307b-4311-8c21-8ad9576f9db4 is going to be created. [ 648.199852] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.201110] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.201110] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.201110] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.201375] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.201654] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.527517] env[65381]: INFO networking_nsxv3.common.synchronization [None req-81de08af-37dd-414d-99b4-6d23274b150a None None] Enqueued Resource ID: af47de2d-f9b8-4d48-841b-eb90f5834c38 with Priority: HIGHEST for action port [ 648.528135] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af47de2d-f9b8-4d48-841b-eb90f5834c38 with Priority: HIGHEST for action port [ 648.528622] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-af47de2d-f9b8-4d48-841b-eb90f5834c38 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.528841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af47de2d-f9b8-4d48-841b-eb90f5834c38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.528912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af47de2d-f9b8-4d48-841b-eb90f5834c38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.529180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af47de2d-f9b8-4d48-841b-eb90f5834c38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.530100] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af47de2d-f9b8-4d48-841b-eb90f5834c38',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.972252] env[65381]: INFO networking_nsxv3.common.synchronization [req-4c9ed873-4787-4359-af0f-646c127969ec req-9fd88c09-da5b-4b06-9b44-48dbb3290bcc tempest-ImagesNegativeTestJSON-1506270380 tempest-ImagesNegativeTestJSON-1506270380-project-member] Enqueued Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_members [ 648.972788] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGHEST for action security_group_members [ 648.973909] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.974098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.974179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.974399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.974571] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.974683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.975101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.975383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.976205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.976293] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.985570] env[65381]: INFO networking_nsxv3.common.synchronization [req-cdd20ea0-2380-47a3-b59e-ffc75e059485 req-90a9df75-467b-44b5-8511-c176ed432c96 service nova] Enqueued Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_rules [ 648.985730] env[65381]: INFO networking_nsxv3.common.synchronization [req-cdd20ea0-2380-47a3-b59e-ffc75e059485 req-90a9df75-467b-44b5-8511-c176ed432c96 service nova] Enqueued Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_members [ 648.985857] env[65381]: INFO networking_nsxv3.common.synchronization [req-cdd20ea0-2380-47a3-b59e-ffc75e059485 req-90a9df75-467b-44b5-8511-c176ed432c96 service nova] Enqueued Resource ID: 0ad00af2-307b-4311-8c21-8ad9576f9db4 with Priority: HIGHEST for action port [ 648.986372] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_rules [ 648.986528] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_members [ 648.986665] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad00af2-307b-4311-8c21-8ad9576f9db4 with Priority: HIGHEST for action port [ 648.986909] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.990888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.990888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.991100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.991100] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.991932] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.992083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.992169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.992342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.992496] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.992596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.992666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.992815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.992908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.992998] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.994874] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ad00af2-307b-4311-8c21-8ad9576f9db4 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.995034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.995088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.995252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.995319] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad00af2-307b-4311-8c21-8ad9576f9db4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.032930] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af47de2d-f9b8-4d48-841b-eb90f5834c38 [ 649.032930] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.033197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.033197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.033422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.033526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.033620] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af47de2d-f9b8-4d48-841b-eb90f5834c38 already deleted. [ 649.033723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af47de2d-f9b8-4d48-841b-eb90f5834c38" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.300266] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 in Status: SUCCESS [ 649.300266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.360731] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1557d918-49f7-412d-b4cd-f9f8b01961f8 None None] Enqueued Resource ID: f7402319-2497-43c5-b604-0b02b82c7ffe with Priority: HIGHEST for action port [ 649.360850] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7402319-2497-43c5-b604-0b02b82c7ffe with Priority: HIGHEST for action port [ 649.361925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7402319-2497-43c5-b604-0b02b82c7ffe taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.362699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7402319-2497-43c5-b604-0b02b82c7ffe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.362699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7402319-2497-43c5-b604-0b02b82c7ffe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.362699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7402319-2497-43c5-b604-0b02b82c7ffe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.362944] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7402319-2497-43c5-b604-0b02b82c7ffe',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.479281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.479442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.479442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.479628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.479715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.479922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.480077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.480156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.480243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.480319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.480401] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf is going to be updated. [ 649.497714] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.498747] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.498847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.503495] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ad00af2-307b-4311-8c21-8ad9576f9db4 with status ACTIVE [ 649.506116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.506116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.506116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.506116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.506116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.506116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.506626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.506626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.506626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.506626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.506626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.506845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.506845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.506923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.506960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.507229] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ad00af2-307b-4311-8c21-8ad9576f9db4 is going to be updated. [ 649.512758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.513012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.513012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.513495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.513495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.524956] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf in Status: IN_PROGRESS for 2s [ 649.534218] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.534358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.534431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.534691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.534848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.535048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ad00af2-307b-4311-8c21-8ad9576f9db4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.865293] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7402319-2497-43c5-b604-0b02b82c7ffe [ 649.865528] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.865665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.865737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.866059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.866175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.866361] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7402319-2497-43c5-b604-0b02b82c7ffe already deleted. [ 649.866437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7402319-2497-43c5-b604-0b02b82c7ffe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.917037] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 in Status: SUCCESS [ 649.917037] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 deletion is rescheduled due to dependency. [ 649.917037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.006530] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.515392] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.515392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.515392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.515392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.515392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.515392] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 is going to be created. [ 650.544209] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.544209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.544209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.544209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.544209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.556235] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 in Status: UNINITIALIZED for 2s [ 651.536156] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf in Status: SUCCESS [ 651.536580] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf deletion is rescheduled due to dependency. [ 651.536580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.976778] env[65381]: INFO networking_nsxv3.common.synchronization [None req-2c915a38-5227-4f5a-85ab-32220eed3f41 None None] Enqueued Resource ID: 46870b37-cecd-482a-af6a-6f264f41f68c with Priority: HIGHEST for action port [ 651.977058] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46870b37-cecd-482a-af6a-6f264f41f68c with Priority: HIGHEST for action port [ 651.977370] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-46870b37-cecd-482a-af6a-6f264f41f68c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.977489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46870b37-cecd-482a-af6a-6f264f41f68c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.977558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46870b37-cecd-482a-af6a-6f264f41f68c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.977859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46870b37-cecd-482a-af6a-6f264f41f68c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.977962] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46870b37-cecd-482a-af6a-6f264f41f68c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.480751] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46870b37-cecd-482a-af6a-6f264f41f68c [ 652.481043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.481169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.481250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.481457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.481590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.481707] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46870b37-cecd-482a-af6a-6f264f41f68c already deleted. [ 652.481807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46870b37-cecd-482a-af6a-6f264f41f68c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.566463] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 in Status: SUCCESS [ 652.566463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.569064] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.569064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.569064] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.074927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.075276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.075276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.075369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.075514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.075574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.075653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.076265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.076265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.076265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.076265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.076265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.076265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.077025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.077025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.077025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.077025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.077025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.077025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.077025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.077413] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.580150] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 53de03fd-4fbd-4af6-8e63-64f644b84c00: rpc.has_security_group_logging(os_id): False [ 653.602696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.603466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.603926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.605133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.605133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.605133] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.605133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.605708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.606103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.606416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.607334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.607334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.607334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.607853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.608485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.608485] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.608485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.608485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.608739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.608777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.608852] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 is going to be created. [ 653.677199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.677199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.677199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.678075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.678075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.689067] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 in Status: IN_PROGRESS for 2s [ 654.753540] env[65381]: INFO networking_nsxv3.common.synchronization [None req-65d660d4-f267-4a41-b03c-fc15ecad0cc8 None None] Enqueued Resource ID: 3a663d2b-ea3f-406c-be3e-fcd65e80bedc with Priority: HIGHEST for action port [ 654.754584] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a663d2b-ea3f-406c-be3e-fcd65e80bedc with Priority: HIGHEST for action port [ 654.754733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a663d2b-ea3f-406c-be3e-fcd65e80bedc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.754908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a663d2b-ea3f-406c-be3e-fcd65e80bedc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.754908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a663d2b-ea3f-406c-be3e-fcd65e80bedc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.759078] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a663d2b-ea3f-406c-be3e-fcd65e80bedc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.759078] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a663d2b-ea3f-406c-be3e-fcd65e80bedc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.265964] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a663d2b-ea3f-406c-be3e-fcd65e80bedc [ 655.266545] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.266545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.266545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.266545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.266791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.266791] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a663d2b-ea3f-406c-be3e-fcd65e80bedc already deleted. [ 655.266791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a663d2b-ea3f-406c-be3e-fcd65e80bedc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.309467] env[65381]: INFO networking_nsxv3.common.synchronization [req-a1a53f29-f112-4303-9a0e-c93d51a46f51 req-c8191eca-86ab-48c1-ae4e-42aa4f8b7596 tempest-InstanceActionsTestJSON-1769376671 tempest-InstanceActionsTestJSON-1769376671-project-member] Enqueued Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_members [ 655.309995] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_members [ 655.310326] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.310466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.310531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.310778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.310929] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.311042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.311124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.311277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.311431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.311536] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.587453] env[65381]: INFO networking_nsxv3.common.synchronization [None req-45eb280c-2685-48a9-a1d0-f728fff84d8c None None] Enqueued Resource ID: add742ff-ce75-4dbd-abfd-9c0acb21da60 with Priority: HIGHEST for action port [ 655.589483] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: add742ff-ce75-4dbd-abfd-9c0acb21da60 with Priority: HIGHEST for action port [ 655.589483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-add742ff-ce75-4dbd-abfd-9c0acb21da60 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.589483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-add742ff-ce75-4dbd-abfd-9c0acb21da60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.589483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-add742ff-ce75-4dbd-abfd-9c0acb21da60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.589784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-add742ff-ce75-4dbd-abfd-9c0acb21da60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.589878] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('add742ff-ce75-4dbd-abfd-9c0acb21da60',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.702798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 in Status: SUCCESS [ 655.703503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.814948] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.815222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.815222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.815523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.815523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.815844] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.815844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.815844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.816056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.816098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.817138] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 already deleted. [ 655.817138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.875350] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.875540] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-586" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.875791] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-586" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.875980] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-586" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.876318] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.876513] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.876675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.876892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.877066] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.877325] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.877503] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.877636] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.877763] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.877890] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.878033] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.878495] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.899067] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.899323] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.899841] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.899841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-586" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.899973] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.900133] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.900246] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.900545] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.900768] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea0beb52-8121-4c5b-a355-f3de4b4c0e7e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.918721] env[65381]: INFO networking_nsxv3.common.synchronization [None req-63f59a30-579b-4478-a2f5-778611428bd9 None None] Enqueued Resource ID: 55263173-b049-496a-ac26-e2ea159a2354 with Priority: HIGHEST for action port [ 655.919685] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55263173-b049-496a-ac26-e2ea159a2354 with Priority: HIGHEST for action port [ 655.919788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-55263173-b049-496a-ac26-e2ea159a2354 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.919901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55263173-b049-496a-ac26-e2ea159a2354" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.920307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55263173-b049-496a-ac26-e2ea159a2354" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.920902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55263173-b049-496a-ac26-e2ea159a2354" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.920902] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55263173-b049-496a-ac26-e2ea159a2354',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.094850] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port add742ff-ce75-4dbd-abfd-9c0acb21da60 [ 656.099254] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.099254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.099254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.099254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.099254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.099254] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:add742ff-ce75-4dbd-abfd-9c0acb21da60 already deleted. [ 656.099254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-add742ff-ce75-4dbd-abfd-9c0acb21da60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.403259] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.403499] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.403625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.403903] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.404053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.404212] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port ea0beb52-8121-4c5b-a355-f3de4b4c0e7e not found, creating... [ 656.404473] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.404626] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.404738] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.404953] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.405102] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.405385] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.405558] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.405684] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.405965] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.406430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.406630] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: ea0beb52-8121-4c5b-a355-f3de4b4c0e7e is going to be created. [ 656.423609] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55263173-b049-496a-ac26-e2ea159a2354 [ 656.423609] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.423609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.423609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.423609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.423609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.423609] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55263173-b049-496a-ac26-e2ea159a2354 already deleted. [ 656.423609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55263173-b049-496a-ac26-e2ea159a2354" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.430059] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.430059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.430059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.430295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.430527] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.430597] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.205592] env[65381]: INFO networking_nsxv3.common.synchronization [req-18c8ce6c-1011-4fbe-a927-96cc556542f4 req-48e8e570-be2a-4cec-951d-66952c591a35 tempest-DeleteServersAdminTestJSON-2008928171 tempest-DeleteServersAdminTestJSON-2008928171-project-member] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 657.206343] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 657.206683] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.207064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.207064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.209035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.209035] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.209379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.209492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.209777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.209897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.210057] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.237966] env[65381]: INFO networking_nsxv3.common.synchronization [req-a1a53f29-f112-4303-9a0e-c93d51a46f51 req-2c4b2898-8101-49ae-8515-1e25727fba86 service nova] Enqueued Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_rules [ 657.237966] env[65381]: INFO networking_nsxv3.common.synchronization [req-a1a53f29-f112-4303-9a0e-c93d51a46f51 req-2c4b2898-8101-49ae-8515-1e25727fba86 service nova] Enqueued Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_members [ 657.237966] env[65381]: INFO networking_nsxv3.common.synchronization [req-a1a53f29-f112-4303-9a0e-c93d51a46f51 req-2c4b2898-8101-49ae-8515-1e25727fba86 service nova] Enqueued Resource ID: ea0beb52-8121-4c5b-a355-f3de4b4c0e7e with Priority: HIGHEST for action port [ 657.238560] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_rules [ 657.240277] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_members [ 657.240277] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea0beb52-8121-4c5b-a355-f3de4b4c0e7e with Priority: HIGHEST for action port [ 657.240277] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.240277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.240454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.240570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.240650] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.242110] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.242110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.242110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.242374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.242457] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.242504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.242553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.246779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.246874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.246972] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.247810] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.247919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.247986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.248173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.248244] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea0beb52-8121-4c5b-a355-f3de4b4c0e7e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.713856] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.714042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.714114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.714424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.714424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.714602] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.714703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.714765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.714918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.714995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.715085] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be updated. [ 657.747258] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.747479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.747553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.747745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.747920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.751067] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.751730] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.751864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.751986] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea0beb52-8121-4c5b-a355-f3de4b4c0e7e with status ACTIVE [ 657.752221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.752296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.752337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.752544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.752611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.753654] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.753654] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.753654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.754118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.754118] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea0beb52-8121-4c5b-a355-f3de4b4c0e7e is going to be updated. [ 657.765992] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: IN_PROGRESS for 2s [ 657.776520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.776680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.777155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.777462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.777560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.778123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea0beb52-8121-4c5b-a355-f3de4b4c0e7e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.855027] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.855534] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.856446] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.856845] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.857563] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.857977] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.858254] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.858946] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.859250] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.860261] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.860320] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.860428] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.860538] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.860649] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.860751] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.860883] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.882919] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.882919] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.883154] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.883198] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.883641] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-c64a5fea-0102-4678-a02c-bd172d7c3177 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.883824] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.883940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.884274] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.884411] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c64a5fea-0102-4678-a02c-bd172d7c3177',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.087011] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b4aa45ed-87e8-4edd-8425-d4cc9ec47d45 None None] Enqueued Resource ID: 20198c6c-34f0-4644-8b03-66d985bcd2d4 with Priority: HIGHEST for action port [ 658.087563] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20198c6c-34f0-4644-8b03-66d985bcd2d4 with Priority: HIGHEST for action port [ 658.087842] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-20198c6c-34f0-4644-8b03-66d985bcd2d4 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.088113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20198c6c-34f0-4644-8b03-66d985bcd2d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.088113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20198c6c-34f0-4644-8b03-66d985bcd2d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.088287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20198c6c-34f0-4644-8b03-66d985bcd2d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.088371] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20198c6c-34f0-4644-8b03-66d985bcd2d4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.256064] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.388543] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.389885] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.389885] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.389885] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.389885] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.389885] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port c64a5fea-0102-4678-a02c-bd172d7c3177 not found, creating... [ 658.390435] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.390435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.390435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.390594] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.390665] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.391027] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.391198] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.391357] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.391981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.391981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.391981] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: c64a5fea-0102-4678-a02c-bd172d7c3177 is going to be created. [ 658.420624] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.420847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.420963] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.421319] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.421645] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.421946] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.591162] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20198c6c-34f0-4644-8b03-66d985bcd2d4 [ 658.591162] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.591162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.591363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.591501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.591754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.591754] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20198c6c-34f0-4644-8b03-66d985bcd2d4 already deleted. [ 658.591959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20198c6c-34f0-4644-8b03-66d985bcd2d4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.704764] env[65381]: INFO networking_nsxv3.common.synchronization [None req-71cceaa3-d99d-4cc0-81ce-0672e73f4d07 None None] Enqueued Resource ID: aa0ea822-bd62-4c16-9325-727f1d29d508 with Priority: HIGHEST for action port [ 658.705390] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0ea822-bd62-4c16-9325-727f1d29d508 with Priority: HIGHEST for action port [ 658.705739] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa0ea822-bd62-4c16-9325-727f1d29d508 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.705878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa0ea822-bd62-4c16-9325-727f1d29d508" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.705956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa0ea822-bd62-4c16-9325-727f1d29d508" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.706716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa0ea822-bd62-4c16-9325-727f1d29d508" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.706813] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa0ea822-bd62-4c16-9325-727f1d29d508',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.763743] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.763911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.763982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.764204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.764306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.764430] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 is going to be created. [ 658.815535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.815773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.815836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.818200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.819088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.831778] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 in Status: UNINITIALIZED for 2s [ 659.217889] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa0ea822-bd62-4c16-9325-727f1d29d508 [ 659.217889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.217889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.217889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.217889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.217889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.217889] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa0ea822-bd62-4c16-9325-727f1d29d508 already deleted. [ 659.217889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa0ea822-bd62-4c16-9325-727f1d29d508" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.241505] env[65381]: INFO networking_nsxv3.common.synchronization [req-18c8ce6c-1011-4fbe-a927-96cc556542f4 req-eecd861f-da78-4905-83d1-f8ae79069c71 service nova] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_rules [ 659.241690] env[65381]: INFO networking_nsxv3.common.synchronization [req-18c8ce6c-1011-4fbe-a927-96cc556542f4 req-eecd861f-da78-4905-83d1-f8ae79069c71 service nova] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 659.241801] env[65381]: INFO networking_nsxv3.common.synchronization [req-18c8ce6c-1011-4fbe-a927-96cc556542f4 req-eecd861f-da78-4905-83d1-f8ae79069c71 service nova] Enqueued Resource ID: c64a5fea-0102-4678-a02c-bd172d7c3177 with Priority: HIGHEST for action port [ 659.242400] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_rules [ 659.242619] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 659.242657] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c64a5fea-0102-4678-a02c-bd172d7c3177 with Priority: HIGHEST for action port [ 659.242920] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.243071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.243144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.243341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.243476] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.245021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.245133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.245360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c64a5fea-0102-4678-a02c-bd172d7c3177 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.245508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.245603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.245837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.245919] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c64a5fea-0102-4678-a02c-bd172d7c3177',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.746175] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.747106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751150] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c64a5fea-0102-4678-a02c-bd172d7c3177 with status ACTIVE [ 659.751401] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.751537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.751603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.751862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.751951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.752187] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.752324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.752384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.752556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.753702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.753702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.753702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.753702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.753702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.753702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.753702] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c64a5fea-0102-4678-a02c-bd172d7c3177 is going to be updated. [ 659.794036] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 659.794036] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 deletion is rescheduled due to dependency. [ 659.794036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.794316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.794316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.795481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.795481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.795481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.795481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.795481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.795481] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.797551] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.797680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.797754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.797961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.798216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.798305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c64a5fea-0102-4678-a02c-bd172d7c3177" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.094941] env[65381]: INFO networking_nsxv3.common.synchronization [None req-4e5a94ac-83e7-4d60-96e8-03757b41fafe None None] Enqueued Resource ID: 78a50503-d58a-49ff-897a-b82d37ca8f16 with Priority: HIGHEST for action port [ 660.094941] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a50503-d58a-49ff-897a-b82d37ca8f16 with Priority: HIGHEST for action port [ 660.095878] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-78a50503-d58a-49ff-897a-b82d37ca8f16 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.095878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78a50503-d58a-49ff-897a-b82d37ca8f16" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.095878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78a50503-d58a-49ff-897a-b82d37ca8f16" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.096092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78a50503-d58a-49ff-897a-b82d37ca8f16" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.096182] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a50503-d58a-49ff-897a-b82d37ca8f16',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.300639] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.390825] env[65381]: INFO networking_nsxv3.common.synchronization [None req-513144b1-288d-4cae-92f0-4c9217812b84 None None] Enqueued Resource ID: b57d1c4c-3026-43e5-88dd-57251a62888a with Priority: HIGHEST for action port [ 660.391623] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57d1c4c-3026-43e5-88dd-57251a62888a with Priority: HIGHEST for action port [ 660.392299] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b57d1c4c-3026-43e5-88dd-57251a62888a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.392504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b57d1c4c-3026-43e5-88dd-57251a62888a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.392617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b57d1c4c-3026-43e5-88dd-57251a62888a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.392930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b57d1c4c-3026-43e5-88dd-57251a62888a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.393073] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b57d1c4c-3026-43e5-88dd-57251a62888a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.599115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78a50503-d58a-49ff-897a-b82d37ca8f16 [ 660.599388] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.601088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.601088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.601088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.601088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.601088] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78a50503-d58a-49ff-897a-b82d37ca8f16 already deleted. [ 660.601088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78a50503-d58a-49ff-897a-b82d37ca8f16" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.804147] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.814963] env[65381]: INFO networking_nsxv3.common.synchronization [req-c251efd6-7e8d-48a6-8a26-5f0a7845d7df req-770b2efb-b1b0-45dd-855b-fbec342209f9 tempest-ImagesOneServerTestJSON-181662735 tempest-ImagesOneServerTestJSON-181662735-project-member] Enqueued Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_members [ 660.815532] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_members [ 660.815771] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.815900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.815966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.817086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.817086] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.817295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.817353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.817896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.817896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.817896] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.843658] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 in Status: SUCCESS [ 660.843966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.844160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.844484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.844690] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.844807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.844872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.845068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.845121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.845773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.845773] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.896610] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b57d1c4c-3026-43e5-88dd-57251a62888a [ 660.896610] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.896610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.896610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.896610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.896610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.896610] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b57d1c4c-3026-43e5-88dd-57251a62888a already deleted. [ 660.896991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b57d1c4c-3026-43e5-88dd-57251a62888a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.307566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.307803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.308317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.308317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.308456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.308513] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be updated. [ 661.325315] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.325315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.325315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.325629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.325629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.325828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.325946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.325990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.326159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.326236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.326356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 already deleted. [ 661.326419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.349431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.349644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.349744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.350256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.350349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.354826] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.354826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.354826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.355118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.355223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.355339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.355464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.355719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.355802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.355889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.356048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.359027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.359027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.359027] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.369313] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: IN_PROGRESS for 2s [ 661.425712] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.425932] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-446" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.426042] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-446" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.426433] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-446" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.426904] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.427145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.427297] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.427601] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.427842] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.428097] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.428211] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.428327] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.428423] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.428529] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.428680] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.428748] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.452374] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.452561] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.452707] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.452887] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-446" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453242] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-c77f4ef8-3488-4b23-8c87-298b9178049f taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.453472] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.453554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.454244] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.454244] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77f4ef8-3488-4b23-8c87-298b9178049f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.861834] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fc522b2-0ead-4b7f-a221-ba7a88af5839: rpc.has_security_group_logging(os_id): False [ 661.885484] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.885650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.885723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.885941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.886032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.886262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.886374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.886439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.886684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.886768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.886954] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.887059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.887120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.887265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.887338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.887517] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.887611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.887684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.887828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.887904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.887988] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 is going to be created. [ 661.895142] env[65381]: INFO networking_nsxv3.common.synchronization [None req-0a7d5f74-6a93-4b74-9ccd-ed979d2344cd tempest-ServersTestBootFromVolume-545680696 tempest-ServersTestBootFromVolume-545680696-project-member] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_rules [ 661.895707] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_rules [ 661.895974] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.896124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.896285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.896447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.896547] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.958271] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.958511] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.958620] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.958837] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.959929] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.960163] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port c77f4ef8-3488-4b23-8c87-298b9178049f not found, creating... [ 661.960573] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.960800] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.962448] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.962788] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.963059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.964437] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.964620] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.964738] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.965013] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.965194] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.965308] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: c77f4ef8-3488-4b23-8c87-298b9178049f is going to be created. [ 661.990271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.990271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.990271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.990457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.991351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.993241] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.993553] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.993679] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.994217] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.994217] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.994742] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.009370] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 in Status: IN_PROGRESS for 2s [ 662.420138] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.420390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.420466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.420687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.420779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.420874] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 already deleted. [ 662.420960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.437201] env[65381]: INFO networking_nsxv3.common.synchronization [None req-22a4e8f7-19c7-4aba-ae4e-16b922726a39 tempest-ServersTestBootFromVolume-545680696 tempest-ServersTestBootFromVolume-545680696-project-member] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_rules [ 662.438109] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_rules [ 662.439803] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.439803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.439803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.439803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.440578] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.870260] env[65381]: INFO networking_nsxv3.common.synchronization [req-c251efd6-7e8d-48a6-8a26-5f0a7845d7df req-1b546183-d8ad-4e19-aade-ce85e3bbdea8 service nova] Enqueued Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_rules [ 662.870260] env[65381]: INFO networking_nsxv3.common.synchronization [req-c251efd6-7e8d-48a6-8a26-5f0a7845d7df req-1b546183-d8ad-4e19-aade-ce85e3bbdea8 service nova] Enqueued Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_members [ 662.870260] env[65381]: INFO networking_nsxv3.common.synchronization [req-c251efd6-7e8d-48a6-8a26-5f0a7845d7df req-1b546183-d8ad-4e19-aade-ce85e3bbdea8 service nova] Enqueued Resource ID: c77f4ef8-3488-4b23-8c87-298b9178049f with Priority: HIGHEST for action port [ 662.870260] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_rules [ 662.870260] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_members [ 662.870260] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c77f4ef8-3488-4b23-8c87-298b9178049f with Priority: HIGHEST for action port [ 662.870260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.870260] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.870260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.870260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.870260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.880072] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.880072] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c77f4ef8-3488-4b23-8c87-298b9178049f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.880072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.880072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.880072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.880072] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c77f4ef8-3488-4b23-8c87-298b9178049f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.963577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.963761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.963812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.964083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.964177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.964216] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 already deleted. [ 662.964599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.332549] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.334714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.334714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.335201] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c77f4ef8-3488-4b23-8c87-298b9178049f with status ACTIVE [ 663.335431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.335678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.335678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.335833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.335920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.336105] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.336207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.336271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.336431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.336502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.336750] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.336855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.336855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.336956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.337043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.337126] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c77f4ef8-3488-4b23-8c87-298b9178049f is going to be updated. [ 663.368579] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.368713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.368713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.369208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.369208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.369428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c77f4ef8-3488-4b23-8c87-298b9178049f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.389186] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 663.389449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.389639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.389876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.390087] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.390286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.391709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.391953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.392713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.392713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.392713] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.397211] env[65381]: INFO networking_nsxv3.common.synchronization [req-36a3787f-a612-45c3-a6ab-f0c3220bb1eb req-5763b382-e293-49e6-8e82-341ae2860074 tempest-ServerExternalEventsTest-2122516996 tempest-ServerExternalEventsTest-2122516996-project-member] Enqueued Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_members [ 663.398634] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_members [ 663.398892] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.400424] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.400424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.403856] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.599388] env[65381]: INFO networking_nsxv3.common.synchronization [None req-3a286e32-d53a-4b4f-8a40-325f4f867e75 None None] Enqueued Resource ID: 177d7a9c-558b-4f70-88df-dfd18395cd06 with Priority: HIGHEST for action port [ 663.599923] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177d7a9c-558b-4f70-88df-dfd18395cd06 with Priority: HIGHEST for action port [ 663.601427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-177d7a9c-558b-4f70-88df-dfd18395cd06 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.601427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177d7a9c-558b-4f70-88df-dfd18395cd06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.601427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177d7a9c-558b-4f70-88df-dfd18395cd06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.601427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177d7a9c-558b-4f70-88df-dfd18395cd06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.601427] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177d7a9c-558b-4f70-88df-dfd18395cd06',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.812149] env[65381]: INFO networking_nsxv3.common.synchronization [None req-978072d1-d1b0-459f-9bb3-cec051472935 None None] Enqueued Resource ID: 93fa9f38-6454-4677-85d1-0efbc8ade382 with Priority: HIGHEST for action port [ 663.812926] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93fa9f38-6454-4677-85d1-0efbc8ade382 with Priority: HIGHEST for action port [ 663.815414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-93fa9f38-6454-4677-85d1-0efbc8ade382 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.815552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93fa9f38-6454-4677-85d1-0efbc8ade382" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.815688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93fa9f38-6454-4677-85d1-0efbc8ade382" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.815975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93fa9f38-6454-4677-85d1-0efbc8ade382" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.816082] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93fa9f38-6454-4677-85d1-0efbc8ade382',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.836922] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.898774] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.899154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.899154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.899425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.899508] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.899602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.899667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.899833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.900125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.900125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.900199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.900448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.900448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.900564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.900659] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.900814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.900855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.901168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.901168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.901168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.901326] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.910472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.910472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.910472] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 274f904b-e458-4b4b-9611-3ae0669bc24b already deleted. [ 663.910472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.025904] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 in Status: SUCCESS [ 664.025904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.103336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 177d7a9c-558b-4f70-88df-dfd18395cd06 [ 664.103661] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.103847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.103900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.104134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.104231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.104334] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:177d7a9c-558b-4f70-88df-dfd18395cd06 already deleted. [ 664.104427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177d7a9c-558b-4f70-88df-dfd18395cd06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.179376] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.179645] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.180487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.180487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.180851] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.181029] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.181534] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.181733] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.181956] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.182247] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.182414] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.182562] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.182795] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.182795] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.184662] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.184662] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.223111] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.223378] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.224901] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.224901] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.224901] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-227e2a5a-b7c0-4318-96f5-9a293a734923 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.224901] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.224901] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.225457] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.225457] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('227e2a5a-b7c0-4318-96f5-9a293a734923',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.319599] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93fa9f38-6454-4677-85d1-0efbc8ade382 [ 664.319887] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.319990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.320086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.320322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.321645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.321645] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93fa9f38-6454-4677-85d1-0efbc8ade382 already deleted. [ 664.321645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93fa9f38-6454-4677-85d1-0efbc8ade382" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.341838] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.341838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.341838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.341838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.341838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.341838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 is going to be created. [ 664.371883] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.372120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.372210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.372684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.374181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.384667] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 in Status: UNINITIALIZED for 2s [ 664.407829] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca937f1d-ad54-42e4-88d0-5a460de400c2: rpc.has_security_group_logging(os_id): False [ 664.434175] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.434369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.434416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.434605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.435992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.435992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.435992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.437974] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.438798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.439712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.439833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.439929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.440050] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be updated. [ 664.555301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.555301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.555301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.555301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.555301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.579098] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: IN_PROGRESS for 2s [ 664.732045] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.732045] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 227e2a5a-b7c0-4318-96f5-9a293a734923 not found, creating... [ 664.732045] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.732045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.734561] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.734561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.734561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.734561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.734561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.734561] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 227e2a5a-b7c0-4318-96f5-9a293a734923 is going to be created. [ 664.771272] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.771638] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.771735] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.772049] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.772970] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.772970] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.450818] env[65381]: INFO networking_nsxv3.common.synchronization [None req-262d18bd-f733-469d-8fb3-05bb1c13e8d8 None None] Enqueued Resource ID: 47d9537b-1575-4e75-88f0-043624c27dcf with Priority: HIGHEST for action port [ 665.451474] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d9537b-1575-4e75-88f0-043624c27dcf with Priority: HIGHEST for action port [ 665.451785] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-47d9537b-1575-4e75-88f0-043624c27dcf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.451917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47d9537b-1575-4e75-88f0-043624c27dcf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.451984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47d9537b-1575-4e75-88f0-043624c27dcf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.455528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47d9537b-1575-4e75-88f0-043624c27dcf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.455715] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47d9537b-1575-4e75-88f0-043624c27dcf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.485484] env[65381]: INFO networking_nsxv3.common.synchronization [req-36a3787f-a612-45c3-a6ab-f0c3220bb1eb req-71291f6a-47d8-4280-b75d-2d9c40b0e06f service nova] Enqueued Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_rules [ 665.485724] env[65381]: INFO networking_nsxv3.common.synchronization [req-36a3787f-a612-45c3-a6ab-f0c3220bb1eb req-71291f6a-47d8-4280-b75d-2d9c40b0e06f service nova] Enqueued Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_members [ 665.485890] env[65381]: INFO networking_nsxv3.common.synchronization [req-36a3787f-a612-45c3-a6ab-f0c3220bb1eb req-71291f6a-47d8-4280-b75d-2d9c40b0e06f service nova] Enqueued Resource ID: 227e2a5a-b7c0-4318-96f5-9a293a734923 with Priority: HIGHEST for action port [ 665.486901] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_rules [ 665.487269] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_members [ 665.487622] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 227e2a5a-b7c0-4318-96f5-9a293a734923 with Priority: HIGHEST for action port [ 665.487622] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.487914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.487914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.488118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.488206] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.489492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.490361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.490685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.490762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.490949] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.491988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.491988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.492273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.492324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.492449] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.494816] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-227e2a5a-b7c0-4318-96f5-9a293a734923 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.495286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.495286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.499310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.499415] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('227e2a5a-b7c0-4318-96f5-9a293a734923',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.958470] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47d9537b-1575-4e75-88f0-043624c27dcf [ 665.958818] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.958950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.958950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.959332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.959428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.959538] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47d9537b-1575-4e75-88f0-043624c27dcf already deleted. [ 665.959623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47d9537b-1575-4e75-88f0-043624c27dcf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.002269] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.005160] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.005502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.005882] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 227e2a5a-b7c0-4318-96f5-9a293a734923 with status ACTIVE [ 666.006086] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.006314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.006314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.006561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.006659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.006840] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.010026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.010026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.010026] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 227e2a5a-b7c0-4318-96f5-9a293a734923 is going to be updated. [ 666.015678] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9e151cc-4b15-403d-ac35-cd502a33a80d req-8ccba1b0-e11a-4289-90d2-6e7f2515b487 tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 666.016828] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 666.017195] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.017373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.017469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.018550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.018550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.018550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.018550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.018879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.018879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.018982] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.040675] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.040968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.041111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.041412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.041607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.041912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-227e2a5a-b7c0-4318-96f5-9a293a734923" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.534271] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.535049] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.536414] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.537973] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.537973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.538473] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.538473] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.538473] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.538473] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.538473] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.538737] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.538737] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.550863] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 in Status: SUCCESS [ 666.550863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.550863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.550863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.550863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.551083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.551083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.551150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.552031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.552031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.552031] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.559328] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.559520] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.561084] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.561084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.561084] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-3981c1a9-0410-4df9-9617-979d2849bcca taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.561084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.561084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.561084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.561084] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3981c1a9-0410-4df9-9617-979d2849bcca',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.595336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 666.595635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.806228] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1b7e32c4-1674-4e7a-ac93-51ec9f4e3328 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 666.807008] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 666.807426] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.807608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.807679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.808037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.808154] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.921873] env[65381]: INFO networking_nsxv3.common.synchronization [req-f45d4c9f-c461-401f-bcd9-a0923a2a0845 req-e46a63bd-e2ee-46dc-8325-3091ce1b68c4 tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 2f37c2cb-1f70-4a87-bde3-4dac0803e302 with Priority: HIGHEST for action security_group_rules [ 666.923898] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f37c2cb-1f70-4a87-bde3-4dac0803e302 with Priority: HIGHEST for action security_group_rules [ 666.923898] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f37c2cb-1f70-4a87-bde3-4dac0803e302 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.923898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f37c2cb-1f70-4a87-bde3-4dac0803e302" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.923898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f37c2cb-1f70-4a87-bde3-4dac0803e302" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.923898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f37c2cb-1f70-4a87-bde3-4dac0803e302" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.923898] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f37c2cb-1f70-4a87-bde3-4dac0803e302',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.041229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.041439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.041439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.041751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.041751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.041751] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 274f904b-e458-4b4b-9611-3ae0669bc24b is going to be created. [ 667.043338] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.055119] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.055275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.055404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.056040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.056040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.056040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.056040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.056300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.056300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.056300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.056413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.056519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.056561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.057352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.057352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.057352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.057352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.057352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.057352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.057352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.057715] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.067238] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.068267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.068267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.068267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.068267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.068515] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 3981c1a9-0410-4df9-9617-979d2849bcca not found, creating... [ 667.069175] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.069175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.069175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.069622] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.069694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.070339] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.071033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.071129] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.071742] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.071742] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.072219] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 3981c1a9-0410-4df9-9617-979d2849bcca is going to be created. [ 667.085573] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.085750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.085827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.086729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.086729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.106442] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 274f904b-e458-4b4b-9611-3ae0669bc24b in Status: UNINITIALIZED for 2s [ 667.107058] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.107335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.107509] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.107884] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.108179] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.108440] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.163273] env[65381]: INFO networking_nsxv3.common.synchronization [None req-9bb9a346-8499-4a07-8d68-24ce0f7cc881 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 667.163920] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 667.164317] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.164438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.335076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.335076] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 already deleted. [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.335076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.335076] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.476176] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.476391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.476469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.476634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.476831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.476831] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f37c2cb-1f70-4a87-bde3-4dac0803e302 already deleted. [ 667.476974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f37c2cb-1f70-4a87-bde3-4dac0803e302" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.545992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.546348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.546499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.547456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.547456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.547456] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 667.561513] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92b18233-8c11-4b7d-91cb-3bc14d1e9183: rpc.has_security_group_logging(os_id): False [ 667.580459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.580726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.580726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.581064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.581548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.581987] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.585115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.585385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.585721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.585888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.586842] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.586842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.586842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.586842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.587808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.587808] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.587808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.587808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.587808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.587808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.588348] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 is going to be created. [ 667.594741] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.594741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.594741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.595054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.595320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.606210] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 667.668027] env[65381]: INFO networking_nsxv3.common.synchronization [req-4012a02e-f74c-4c53-961d-ee42af6d8207 req-f2bae86a-4ef7-4398-9912-0bde828ea3c5 tempest-ServersTestFqdnHostnames-1355028209 tempest-ServersTestFqdnHostnames-1355028209-project-member] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_members [ 667.668738] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGHEST for action security_group_members [ 667.669474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.669843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.669843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.670089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.670334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.670558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.670654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.671087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.671087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.671213] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.674402] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.674597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.674671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.674972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.675342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.696821] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 in Status: IN_PROGRESS for 2s [ 667.871828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.871990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.872535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.872535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.872642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.872775] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 already deleted. [ 667.872946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.898025] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9e151cc-4b15-403d-ac35-cd502a33a80d req-6359f36c-372b-4c91-9b15-e42e5344b76c service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 667.898025] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9e151cc-4b15-403d-ac35-cd502a33a80d req-6359f36c-372b-4c91-9b15-e42e5344b76c service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 667.898025] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9e151cc-4b15-403d-ac35-cd502a33a80d req-6359f36c-372b-4c91-9b15-e42e5344b76c service nova] Enqueued Resource ID: 3981c1a9-0410-4df9-9617-979d2849bcca with Priority: HIGHEST for action port [ 667.898464] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 667.898683] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 667.898847] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3981c1a9-0410-4df9-9617-979d2849bcca with Priority: HIGHEST for action port [ 667.899242] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.899419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.899521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.899827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.899968] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.904561] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.904561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.904915] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3981c1a9-0410-4df9-9617-979d2849bcca taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.905035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.905138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.905464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.905602] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3981c1a9-0410-4df9-9617-979d2849bcca',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.182687] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.182909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.182909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.183104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.183246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.183352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.183729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.183729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.183729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.183729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.184115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 is going to be updated. [ 668.217684] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.217684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.217684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.218162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.218162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.234292] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 in Status: IN_PROGRESS for 2s [ 668.411884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.411884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.411884] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3981c1a9-0410-4df9-9617-979d2849bcca with status ACTIVE [ 668.411884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.411884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.411884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.412205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.412205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.413788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.413788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.413788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.413788] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3981c1a9-0410-4df9-9617-979d2849bcca is going to be updated. [ 668.439391] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.439391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.439391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.439391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.439656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.439656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3981c1a9-0410-4df9-9617-979d2849bcca" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.454718] env[65381]: INFO networking_nsxv3.common.synchronization [None req-bdb594e0-3582-4c53-b0c6-3797ec086513 None None] Enqueued Resource ID: e7136eff-f559-4927-b92a-dffc55b4006a with Priority: HIGHEST for action port [ 668.454718] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7136eff-f559-4927-b92a-dffc55b4006a with Priority: HIGHEST for action port [ 668.455044] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7136eff-f559-4927-b92a-dffc55b4006a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.455606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7136eff-f559-4927-b92a-dffc55b4006a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.455742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7136eff-f559-4927-b92a-dffc55b4006a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.456078] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7136eff-f559-4927-b92a-dffc55b4006a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.456887] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7136eff-f559-4927-b92a-dffc55b4006a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.691625] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6a64c66-28ab-40d2-a76e-d5079ae58a43 req-b19d79a0-3260-4189-a10c-2bf2a4ef17f0 tempest-ServerTagsTestJSON-176018867 tempest-ServerTagsTestJSON-176018867-project-member] Enqueued Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_members [ 668.692721] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_members [ 668.692721] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.692721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.692973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.693027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.694350] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.694490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.695632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.695632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.695632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.695632] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.966546] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7136eff-f559-4927-b92a-dffc55b4006a [ 668.966794] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.966939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.967015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.967248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.967347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.967449] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7136eff-f559-4927-b92a-dffc55b4006a already deleted. [ 668.967529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7136eff-f559-4927-b92a-dffc55b4006a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.047034] env[65381]: INFO networking_nsxv3.common.synchronization [None req-160cbb8e-bdd9-477b-8349-d43806f1f7a6 tempest-ServersV294TestFqdnHostnames-1279301147 tempest-ServersV294TestFqdnHostnames-1279301147-project-member] Enqueued Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_rules [ 669.047320] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_rules [ 669.048116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.048250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.048328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.048900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.049013] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.120448] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 274f904b-e458-4b4b-9611-3ae0669bc24b in Status: SUCCESS [ 669.122022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.122022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.122022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.123733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.124024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.125024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.125024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.125024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.125024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.125024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.178376] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.178623] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-28" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.178745] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-28" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.179299] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-28" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.179786] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.180276] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.180276] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.180680] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.180909] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.181302] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.181451] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.181586] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.181714] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.181847] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.181970] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.182155] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.199357] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.199647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.199761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.200038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.200163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.200474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.200639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.200743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.200976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.201112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.201328] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 already deleted. [ 669.201462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.207936] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.208220] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.208421] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.208670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-28" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.209075] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-67263b0c-c5b0-4597-ac91-9b34c6d1648e taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.209207] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.209323] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.209880] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.209993] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67263b0c-c5b0-4597-ac91-9b34c6d1648e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.238546] env[65381]: INFO networking_nsxv3.common.synchronization [None req-bcf82340-0b0f-48ab-be67-60e4edf1f834 tempest-ServersV294TestFqdnHostnames-1279301147 tempest-ServersV294TestFqdnHostnames-1279301147-project-member] Enqueued Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_rules [ 669.239249] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_rules [ 669.239613] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.239717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.573054] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.573054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.573054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.573437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.573437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.573437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 already deleted. [ 669.573437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.573808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.573808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.573808] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.623918] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 669.624186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.624392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.624664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.626116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.626276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.626432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.626639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.626765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.628232] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.632374] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.632600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.632600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.633516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.633516] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.633516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.633516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.633516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.633516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.633516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.634719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.634719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.634719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.634719] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.709039] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 in Status: SUCCESS [ 669.709460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.713058] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.713391] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.713391] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.713699] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.713886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.714081] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 67263b0c-c5b0-4597-ac91-9b34c6d1648e not found, creating... [ 669.714361] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.714517] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.714644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.714936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.715104] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.715416] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.715747] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.715747] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.716101] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.716101] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.716217] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 67263b0c-c5b0-4597-ac91-9b34c6d1648e is going to be created. [ 669.740058] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.740259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.740365] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.740881] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.741133] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.741563] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.099265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.099265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.099265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.099622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.099622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.099703] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 already deleted. [ 670.099750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.133415] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.138506] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 274f904b-e458-4b4b-9611-3ae0669bc24b: rpc.has_security_group_logging(os_id): False [ 670.156475] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.156745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.156745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.157034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.157034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.157245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.157389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.157467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.157567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.157652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.157797] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.157921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.158075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.158130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.158190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.158531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.158531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.158531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.158741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.158741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.158810] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 274f904b-e458-4b4b-9611-3ae0669bc24b is going to be created. [ 670.232579] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.232795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.232845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.233076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.233261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.245601] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 in Status: SUCCESS [ 670.245780] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 deletion is rescheduled due to dependency. [ 670.245940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.246852] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 274f904b-e458-4b4b-9611-3ae0669bc24b in Status: IN_PROGRESS for 2s [ 670.467944] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6a64c66-28ab-40d2-a76e-d5079ae58a43 req-6d869de3-f152-4383-838d-6a25448afda3 service nova] Enqueued Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_rules [ 670.468064] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6a64c66-28ab-40d2-a76e-d5079ae58a43 req-6d869de3-f152-4383-838d-6a25448afda3 service nova] Enqueued Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_members [ 670.468164] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6a64c66-28ab-40d2-a76e-d5079ae58a43 req-6d869de3-f152-4383-838d-6a25448afda3 service nova] Enqueued Resource ID: 67263b0c-c5b0-4597-ac91-9b34c6d1648e with Priority: HIGHEST for action port [ 670.468748] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_rules [ 670.468876] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_members [ 670.469071] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67263b0c-c5b0-4597-ac91-9b34c6d1648e with Priority: HIGHEST for action port [ 670.470099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.470230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.472860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.473251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.473367] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.475194] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.476368] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.476368] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.477795] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-67263b0c-c5b0-4597-ac91-9b34c6d1648e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.477912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.477959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.478125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.478200] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67263b0c-c5b0-4597-ac91-9b34c6d1648e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.636111] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.980877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.980877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.980877] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.982018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67263b0c-c5b0-4597-ac91-9b34c6d1648e with status ACTIVE [ 670.982257] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.982405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.982471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.982719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.982832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.987695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.987695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.987695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.987695] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67263b0c-c5b0-4597-ac91-9b34c6d1648e is going to be updated. [ 671.014747] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.014747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.014747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.014747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.014747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.014747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67263b0c-c5b0-4597-ac91-9b34c6d1648e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.139799] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.140154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.140154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.140412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.140595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.140774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 671.184081] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.184262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.184339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.184585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.184694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.202574] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 671.488314] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.621149] env[65381]: INFO networking_nsxv3.common.synchronization [req-9c31168b-4551-40ad-8a1c-ccc073a753ea req-1ee3b468-198e-4d5b-85d4-328dd92316be tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 23c358c4-f1e0-4908-b639-66b4b199aecf with Priority: HIGHEST for action security_group_rules [ 671.621149] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23c358c4-f1e0-4908-b639-66b4b199aecf with Priority: HIGHEST for action security_group_rules [ 671.621149] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23c358c4-f1e0-4908-b639-66b4b199aecf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.621829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23c358c4-f1e0-4908-b639-66b4b199aecf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.621829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23c358c4-f1e0-4908-b639-66b4b199aecf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.622647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23c358c4-f1e0-4908-b639-66b4b199aecf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.622647] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23c358c4-f1e0-4908-b639-66b4b199aecf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.991209] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.991772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.991772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.992030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.992030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.992145] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 is going to be created. [ 672.028042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.028042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.028042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.028349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.028489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.041098] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 in Status: UNINITIALIZED for 2s [ 672.165994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.166177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.166269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.166508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.166625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.166737] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23c358c4-f1e0-4908-b639-66b4b199aecf already deleted. [ 672.166869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23c358c4-f1e0-4908-b639-66b4b199aecf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.262840] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 274f904b-e458-4b4b-9611-3ae0669bc24b in Status: SUCCESS [ 672.265311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.214172] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 673.214895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.214895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.214895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.215127] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.215776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.215776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.215776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.215776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.215776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.215776] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.720034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.720034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.720034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.722182] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.722182] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.722182] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.722182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.722984] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.054537] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 in Status: SUCCESS [ 674.054537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.054742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.055022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.055257] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.055404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.055496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.055685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.055801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.055920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.056050] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.069914] env[65381]: INFO networking_nsxv3.common.synchronization [req-1f85e3ef-7131-4936-8185-0db85cb635ce req-59000757-58cd-4208-8506-2cee64507711 tempest-TenantUsagesTestJSON-754845505 tempest-TenantUsagesTestJSON-754845505-project-member] Enqueued Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_members [ 674.071054] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGHEST for action security_group_members [ 674.071456] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.071569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.071622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.071828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.071984] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.072136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.072195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.072405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.072505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.072582] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.225258] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca1b5748-90c1-473a-ab4f-767cc4ab05d7: rpc.has_security_group_logging(os_id): False [ 674.254209] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.254209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.254209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.254209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.254209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.254464] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.254520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.254562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.254699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.254773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.254971] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.255084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.259054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.259340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.259436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.261827] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.261827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.261827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.261827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.261827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.261827] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 674.355436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.355636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.355636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.356318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.356318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.373479] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 674.559593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.563668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.563668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.563668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.564471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.564471] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.564471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.564471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.564471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.564471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.564471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.564869] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.579021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.579021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.579021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.579021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 is going to be updated. [ 674.621967] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.622410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.622410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.622662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.622794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.638389] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 in Status: IN_PROGRESS for 2s [ 675.069337] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fa502cc-eee4-43e5-bf7a-e5551fb38a40: rpc.has_security_group_logging(os_id): False [ 675.090252] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.090532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.090650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.090998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.091151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.091515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.091720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.091916] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.096021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.096138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.096471] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.096642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.096772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.097012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.097108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.097387] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.097521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.097592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.097781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.097878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.097975] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 is going to be created. [ 675.171079] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.171079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.171079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.171079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.171429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.187346] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 in Status: IN_PROGRESS for 2s [ 675.835273] env[65381]: INFO networking_nsxv3.common.synchronization [None req-4e07467d-0bcf-4f86-ab8f-675c1c658965 None None] Enqueued Resource ID: eebd28ef-2f3b-4077-a443-2ff0827fcb3b with Priority: HIGHEST for action port [ 675.835273] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eebd28ef-2f3b-4077-a443-2ff0827fcb3b with Priority: HIGHEST for action port [ 675.835273] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-eebd28ef-2f3b-4077-a443-2ff0827fcb3b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.835273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eebd28ef-2f3b-4077-a443-2ff0827fcb3b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.836390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eebd28ef-2f3b-4077-a443-2ff0827fcb3b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.836390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eebd28ef-2f3b-4077-a443-2ff0827fcb3b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.836521] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eebd28ef-2f3b-4077-a443-2ff0827fcb3b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.339877] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eebd28ef-2f3b-4077-a443-2ff0827fcb3b [ 676.340250] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.340464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.340555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.340989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.341153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.341153] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eebd28ef-2f3b-4077-a443-2ff0827fcb3b already deleted. [ 676.341317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eebd28ef-2f3b-4077-a443-2ff0827fcb3b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.392524] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 676.392524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.401159] env[65381]: INFO networking_nsxv3.common.synchronization [req-208aa053-731a-48ac-ae4c-ddb35315aa49 req-6868692d-f39e-4eac-afd7-f6eb3612665f tempest-ServerPasswordTestJSON-1929152057 tempest-ServerPasswordTestJSON-1929152057-project-member] Enqueued Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_members [ 676.401466] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_members [ 676.401760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.401899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.401986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.403153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.403153] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.403153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.403153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.403153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.403153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.403153] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.650443] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 in Status: SUCCESS [ 676.650443] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 deletion is rescheduled due to dependency. [ 676.650443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.842216] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.842694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-185" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.842694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-185" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.843614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-185" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.843614] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.843614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.843962] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.844327] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.844430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.844663] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.844779] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.844905] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.845013] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.847734] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.847734] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.847734] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.870173] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.871189] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.871189] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.871189] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-185" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.871841] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-70a16a99-24ed-48a5-a476-3ccd0cf82b97 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.871841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.871841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.872083] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.872133] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70a16a99-24ed-48a5-a476-3ccd0cf82b97',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.907679] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.907679] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.907679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.908230] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd already deleted. [ 676.908230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.210440] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 in Status: SUCCESS [ 677.211251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.375479] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.375933] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.375933] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.376346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.376346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.376428] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 70a16a99-24ed-48a5-a476-3ccd0cf82b97 not found, creating... [ 677.376696] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.376876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.376954] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.377182] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.377310] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.377580] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.377720] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.378066] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.378432] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.378671] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.378858] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 70a16a99-24ed-48a5-a476-3ccd0cf82b97 is going to be created. [ 677.402268] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.402540] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.402677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.402967] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.403269] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.403532] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.127685] env[65381]: INFO networking_nsxv3.common.synchronization [req-208aa053-731a-48ac-ae4c-ddb35315aa49 req-64a9bc82-f6fc-4da2-82cb-babb9f35c88a service nova] Enqueued Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_rules [ 678.127972] env[65381]: INFO networking_nsxv3.common.synchronization [req-208aa053-731a-48ac-ae4c-ddb35315aa49 req-64a9bc82-f6fc-4da2-82cb-babb9f35c88a service nova] Enqueued Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_members [ 678.127972] env[65381]: INFO networking_nsxv3.common.synchronization [req-208aa053-731a-48ac-ae4c-ddb35315aa49 req-64a9bc82-f6fc-4da2-82cb-babb9f35c88a service nova] Enqueued Resource ID: 70a16a99-24ed-48a5-a476-3ccd0cf82b97 with Priority: HIGHEST for action port [ 678.128222] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_rules [ 678.128367] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_members [ 678.129140] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70a16a99-24ed-48a5-a476-3ccd0cf82b97 with Priority: HIGHEST for action port [ 678.130468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.130645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.130716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.130975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.131075] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.131995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.132138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.132206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.132393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.132566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.133799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.133799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.133799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.133799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.134020] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.134695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-70a16a99-24ed-48a5-a476-3ccd0cf82b97 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.134800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.134866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.135036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.135165] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70a16a99-24ed-48a5-a476-3ccd0cf82b97',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.348942] env[65381]: INFO networking_nsxv3.common.synchronization [None req-56813b88-0ee1-4e3b-94b8-0ba5727d2ce9 None None] Enqueued Resource ID: ed3f7035-6844-48aa-879e-3521ababf7cd with Priority: HIGHEST for action port [ 678.349672] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed3f7035-6844-48aa-879e-3521ababf7cd with Priority: HIGHEST for action port [ 678.350009] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed3f7035-6844-48aa-879e-3521ababf7cd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.350226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed3f7035-6844-48aa-879e-3521ababf7cd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.350337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed3f7035-6844-48aa-879e-3521ababf7cd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.350636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed3f7035-6844-48aa-879e-3521ababf7cd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.350723] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed3f7035-6844-48aa-879e-3521ababf7cd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.637556] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.638979] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.640152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.640152] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70a16a99-24ed-48a5-a476-3ccd0cf82b97 with status ACTIVE [ 678.640152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.640152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.640152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.640152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.640152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.640517] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.640517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.640517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.640657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.640657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.641415] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.641645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.642185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.644295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.644295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.644295] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70a16a99-24ed-48a5-a476-3ccd0cf82b97 is going to be updated. [ 678.672403] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.672403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.672730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.672730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.673029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.673029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70a16a99-24ed-48a5-a476-3ccd0cf82b97" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.853780] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed3f7035-6844-48aa-879e-3521ababf7cd [ 678.854044] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.854182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.854251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.854461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.854547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.854640] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed3f7035-6844-48aa-879e-3521ababf7cd already deleted. [ 678.854720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed3f7035-6844-48aa-879e-3521ababf7cd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.147295] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.388573] env[65381]: INFO networking_nsxv3.common.synchronization [req-c2834963-b776-4ad8-8d72-453937ff2da9 req-37ac7d06-34bf-42ea-87cf-11d4bcfd5ba8 tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 32c7f12e-a31a-477c-99c6-2b659a5d265a with Priority: HIGHEST for action security_group_rules [ 679.389318] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c7f12e-a31a-477c-99c6-2b659a5d265a with Priority: HIGHEST for action security_group_rules [ 679.389729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32c7f12e-a31a-477c-99c6-2b659a5d265a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.389729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32c7f12e-a31a-477c-99c6-2b659a5d265a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.389930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32c7f12e-a31a-477c-99c6-2b659a5d265a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.390335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32c7f12e-a31a-477c-99c6-2b659a5d265a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.390335] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32c7f12e-a31a-477c-99c6-2b659a5d265a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.652368] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.652583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.652712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.652871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.652967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.653073] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd is going to be created. [ 679.685915] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.686104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.686170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.686389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.686555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.698542] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd in Status: UNINITIALIZED for 2s [ 679.914248] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.914504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.914504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.914731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.914824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.915032] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32c7f12e-a31a-477c-99c6-2b659a5d265a already deleted. [ 679.915032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32c7f12e-a31a-477c-99c6-2b659a5d265a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.124983] env[65381]: INFO networking_nsxv3.common.synchronization [req-8ded147a-d693-4780-a9a6-b2f90d5f8472 req-054032c7-e1ed-4b1d-a53c-e155f575896c tempest-InstanceActionsV221TestJSON-1368179132 tempest-InstanceActionsV221TestJSON-1368179132-project-member] Enqueued Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_members [ 681.125517] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_members [ 681.125828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.125960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.126180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.127084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.127084] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.127301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.127367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.127592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.127734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.127866] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.132439] env[65381]: INFO networking_nsxv3.common.synchronization [req-73de5cea-761f-404d-bf68-5759f841a179 req-33aa65ff-e233-480e-91b4-5f1f5c0f4c7f tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 681.133640] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 681.133737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.133845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.134055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.134355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.134601] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.134784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.135347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.135648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.135781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.135931] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.159213] env[65381]: INFO networking_nsxv3.common.synchronization [req-73de5cea-761f-404d-bf68-5759f841a179 req-33aa65ff-e233-480e-91b4-5f1f5c0f4c7f tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 681.159213] env[65381]: INFO networking_nsxv3.common.synchronization [req-73de5cea-761f-404d-bf68-5759f841a179 req-33aa65ff-e233-480e-91b4-5f1f5c0f4c7f tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 681.159213] env[65381]: INFO networking_nsxv3.common.synchronization [req-73de5cea-761f-404d-bf68-5759f841a179 req-33aa65ff-e233-480e-91b4-5f1f5c0f4c7f tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with Priority: HIGHEST for action port [ 681.159213] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 681.159213] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 681.159836] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with Priority: HIGHEST for action port [ 681.160269] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.160680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.160997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.161471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.161774] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.163753] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.163994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.164320] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-55234d07-fb90-41b4-b227-6df6d4dd7ac0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.164737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.164935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.165231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.165740] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55234d07-fb90-41b4-b227-6df6d4dd7ac0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.579269] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-886 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.579551] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.579551] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.579894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.580028] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.580393] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.580595] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.580862] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.581019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.581386] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.581386] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.581554] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.581650] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.581758] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.581962] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.582055] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.607136] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.607350] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.607448] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.607616] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.607933] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-74a2dd43-af33-4eb5-b99b-f566e5447213 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.608142] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.608241] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.609180] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.609417] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a2dd43-af33-4eb5-b99b-f566e5447213',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.630234] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.630451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.630501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.631036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.631036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.631518] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.631518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.631518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.631945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.631945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.631945] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad already deleted. [ 681.631945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.639676] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.665479] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.665479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.672029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with status ACTIVE [ 681.672029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.672029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.672029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.672029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.672029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 is going to be updated. [ 681.706335] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.706600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.706600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.706802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.706928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.707121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.709589] env[65381]: INFO networking_nsxv3.common.synchronization [req-20d1f327-2642-420b-9df6-905ae24e730b req-2e30fe63-452a-455c-ab57-edd4732a2c0c tempest-ServerExternalEventsTest-2122516996 tempest-ServerExternalEventsTest-2122516996-project-member] Enqueued Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_members [ 681.710261] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGHEST for action security_group_members [ 681.711205] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd in Status: SUCCESS [ 681.711477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.711788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.711946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.712080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.712349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.712551] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.712724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.712795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.712965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.713133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.713248] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.714270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.714834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.714834] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.714834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.715195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.715195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.715195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.715473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.715473] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.111790] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.112125] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.112245] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.112850] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.112850] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.112983] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 74a2dd43-af33-4eb5-b99b-f566e5447213 not found, creating... [ 682.113276] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.113479] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.113602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.113850] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.114189] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.114337] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.114504] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.114644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.114938] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.115216] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.115305] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 74a2dd43-af33-4eb5-b99b-f566e5447213 is going to be created. [ 682.142279] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.142843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.142843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.143048] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.143337] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.143632] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.144800] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.218745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.218745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.218745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.219303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.219303] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 274f904b-e458-4b4b-9611-3ae0669bc24b is going to be updated. [ 682.222053] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.222471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.222686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.223056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.223304] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.223471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.223621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.223891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.224045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224404] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.224553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.224647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.224905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.226885] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.227098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.227158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.227327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.227415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.227614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.227614] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.293067] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.293426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.293426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.293638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.293638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.307352] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 274f904b-e458-4b4b-9611-3ae0669bc24b in Status: IN_PROGRESS for 2s [ 682.647201] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.647363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.647439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.647667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.647770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.647904] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 682.679442] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.679654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.679793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.679983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.680901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.692270] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 682.733846] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51eca9de-71e7-42ac-8af4-13f26cb274bd: rpc.has_security_group_logging(os_id): False [ 682.750820] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.751766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.752132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.752845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.753157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.753636] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.757022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.757022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.757022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.757022] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd is going to be created. [ 682.846414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.846604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.846662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.846896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.847120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.861860] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd in Status: IN_PROGRESS for 2s [ 682.931454] env[65381]: INFO networking_nsxv3.common.synchronization [req-8ded147a-d693-4780-a9a6-b2f90d5f8472 req-6acf112b-3093-4124-ba6e-e3bfe0d264e4 service nova] Enqueued Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_rules [ 682.931756] env[65381]: INFO networking_nsxv3.common.synchronization [req-8ded147a-d693-4780-a9a6-b2f90d5f8472 req-6acf112b-3093-4124-ba6e-e3bfe0d264e4 service nova] Enqueued Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_members [ 682.931813] env[65381]: INFO networking_nsxv3.common.synchronization [req-8ded147a-d693-4780-a9a6-b2f90d5f8472 req-6acf112b-3093-4124-ba6e-e3bfe0d264e4 service nova] Enqueued Resource ID: 74a2dd43-af33-4eb5-b99b-f566e5447213 with Priority: HIGHEST for action port [ 682.932402] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_rules [ 682.932547] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_members [ 682.932691] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a2dd43-af33-4eb5-b99b-f566e5447213 with Priority: HIGHEST for action port [ 682.932992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.933160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.933214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.933498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.933587] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.934699] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.934821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.934927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.935370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.935370] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.935370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.935555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.935555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.935633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.935698] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.936851] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a2dd43-af33-4eb5-b99b-f566e5447213 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.936979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.937036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.938464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.938464] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a2dd43-af33-4eb5-b99b-f566e5447213',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.438644] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.438912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.438964] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.439926] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74a2dd43-af33-4eb5-b99b-f566e5447213 with status ACTIVE [ 683.440152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.440270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.440539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.440539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.440622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.440797] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.440892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.440956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.441127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.441205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.441406] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.441508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.441569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.441726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.441810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.441891] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74a2dd43-af33-4eb5-b99b-f566e5447213 is going to be updated. [ 683.468820] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.468967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.469046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.469251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.469393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.469544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a2dd43-af33-4eb5-b99b-f566e5447213" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.553382] env[65381]: INFO networking_nsxv3.common.synchronization [req-3ef777e7-0a44-4e66-a189-e186c291edfb req-c6587c85-33af-43f7-a656-d88fd09eaa62 tempest-ServersNegativeTestMultiTenantJSON-781030771 tempest-ServersNegativeTestMultiTenantJSON-781030771-project-member] Enqueued Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_members [ 683.553670] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGHEST for action security_group_members [ 683.553949] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.554076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.554142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.554336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.554487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.554604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.554667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.554827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.554917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.555023] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.862154] env[65381]: INFO networking_nsxv3.common.synchronization [req-2c8f4197-3147-415a-85f2-a606bc4522ff req-8da8a52b-56b7-4503-a058-f01245e7945c tempest-DeleteServersAdminTestJSON-2008928171 tempest-DeleteServersAdminTestJSON-2008928171-project-member] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 683.862154] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGHEST for action security_group_members [ 683.864055] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.864055] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.864055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.864055] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.946711] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.058542] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.058542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.058542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.058542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.058542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.059000] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.059000] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.059000] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.059196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.059310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.059454] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 is going to be updated. [ 684.090715] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.090715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.090715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.090715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.091019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.103333] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 in Status: IN_PROGRESS for 2s [ 684.318306] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 274f904b-e458-4b4b-9611-3ae0669bc24b in Status: SUCCESS [ 684.321482] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 274f904b-e458-4b4b-9611-3ae0669bc24b deletion is rescheduled due to dependency. [ 684.321655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.367814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.367814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.368216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.368216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.368345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.368579] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.368708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.368854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.368907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.368997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.369086] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be updated. [ 684.405477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.405831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.405831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.405966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.406138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.417169] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: IN_PROGRESS for 2s [ 684.453411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.453897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.453897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.453897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.454055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.454108] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad is going to be created. [ 684.490717] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.491198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.491198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.491436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.492014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.508517] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad in Status: UNINITIALIZED for 2s [ 684.704400] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 684.704400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.705624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.705624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.705624] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.705624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.705624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.705624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.705624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.705886] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.878810] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd in Status: SUCCESS [ 684.879064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.030258] env[65381]: INFO networking_nsxv3.common.synchronization [None req-465fb481-1c4f-4311-86ef-e937a5f60885 tempest-MigrationsAdminTest-1004936190 tempest-MigrationsAdminTest-1004936190-project-member] Enqueued Resource ID: 9753fa1c-a589-4f02-95dc-f418cfdc9c56 with Priority: HIGHEST for action security_group_rules [ 685.031013] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9753fa1c-a589-4f02-95dc-f418cfdc9c56 with Priority: HIGHEST for action security_group_rules [ 685.031337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.031541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.031599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.031877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.031948] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9753fa1c-a589-4f02-95dc-f418cfdc9c56',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.159083] env[65381]: INFO networking_nsxv3.common.synchronization [None req-03dfa16b-8eca-439c-8bd6-af91bf790679 tempest-MigrationsAdminTest-1004936190 tempest-MigrationsAdminTest-1004936190-project-member] Enqueued Resource ID: 9753fa1c-a589-4f02-95dc-f418cfdc9c56 with Priority: HIGHEST for action security_group_rules [ 685.159671] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9753fa1c-a589-4f02-95dc-f418cfdc9c56 with Priority: HIGHEST for action security_group_rules [ 685.159983] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.160206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.210471] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.558359] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.558768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.558768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.559080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.559080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.559201] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9753fa1c-a589-4f02-95dc-f418cfdc9c56 already deleted. [ 685.559248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.559540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.561942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.561942] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9753fa1c-a589-4f02-95dc-f418cfdc9c56',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.714386] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.087316] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.087736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.087736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.087831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.087858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.088434] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9753fa1c-a589-4f02-95dc-f418cfdc9c56 already deleted. [ 686.088434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9753fa1c-a589-4f02-95dc-f418cfdc9c56" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.119139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 in Status: SUCCESS [ 686.119478] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 deletion is rescheduled due to dependency. [ 686.119543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.217936] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.218133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.218212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.218436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.218527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.218626] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 686.250509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.250673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.250863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.251109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.251262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.262607] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 686.393554] env[65381]: INFO networking_nsxv3.common.synchronization [req-80a21911-4f5a-43a4-bdc9-dacdb42c2304 req-78c94c4f-6a56-4ba6-b6f7-a9a70bb0a1a8 tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 88b8498f-69a1-47a3-84d3-c610b8c42449 with Priority: HIGHEST for action security_group_rules [ 686.393980] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b8498f-69a1-47a3-84d3-c610b8c42449 with Priority: HIGHEST for action security_group_rules [ 686.394379] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88b8498f-69a1-47a3-84d3-c610b8c42449 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.394506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88b8498f-69a1-47a3-84d3-c610b8c42449" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.394506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88b8498f-69a1-47a3-84d3-c610b8c42449" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.394732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88b8498f-69a1-47a3-84d3-c610b8c42449" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.394815] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88b8498f-69a1-47a3-84d3-c610b8c42449',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.429671] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 in Status: SUCCESS [ 686.429671] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 deletion is rescheduled due to dependency. [ 686.429671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.519569] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad in Status: SUCCESS [ 686.519798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.519976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.520266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.520462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.520585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.520651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.520801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.520883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.520968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.522900] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.917463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.917463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.917463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.917463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.917463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.918506] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88b8498f-69a1-47a3-84d3-c610b8c42449 already deleted. [ 686.918506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88b8498f-69a1-47a3-84d3-c610b8c42449" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.030172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.031441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034350] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.034350] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034350] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.034350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.035086] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.538035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49e6fdae-1268-4ea7-94d5-411cc41d7cad: rpc.has_security_group_logging(os_id): False [ 687.590928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.591739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.591739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.591739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.591739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.591739] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.591934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.591934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.592214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.592294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.592703] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.592839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.592887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.593089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.593163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.593500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.593640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.593711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.593895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.594045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.594139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad is going to be created. [ 687.723100] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.723100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.723100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.723100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.723100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.742584] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad in Status: IN_PROGRESS for 2s [ 688.275307] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 688.275686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.275725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.275974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.276198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.276296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.276360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.276540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.276620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.276725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.276822] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.315148] env[65381]: INFO networking_nsxv3.common.synchronization [None req-9c09ac11-e526-49bc-a168-38cf2a103bf2 None None] Enqueued Resource ID: d2908c9f-8072-4c10-8dc1-601d199c4273 with Priority: HIGHEST for action port [ 688.315692] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2908c9f-8072-4c10-8dc1-601d199c4273 with Priority: HIGHEST for action port [ 688.315995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2908c9f-8072-4c10-8dc1-601d199c4273 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.316140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2908c9f-8072-4c10-8dc1-601d199c4273" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.316203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2908c9f-8072-4c10-8dc1-601d199c4273" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.316471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2908c9f-8072-4c10-8dc1-601d199c4273" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.316553] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2908c9f-8072-4c10-8dc1-601d199c4273',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.737675] env[65381]: INFO networking_nsxv3.common.synchronization [req-2d2fc837-6542-4bfa-8d9d-47a70f939e47 req-9bbffa90-2a27-4a78-acf3-0c6f8be0402f tempest-ServersWithSpecificFlavorTestJSON-513012973 tempest-ServersWithSpecificFlavorTestJSON-513012973-project-member] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 688.738031] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 688.738324] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.738442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.738502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.739451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.739517] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.739641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.739728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.739953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.740066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.740201] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.778496] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.820202] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2908c9f-8072-4c10-8dc1-601d199c4273 [ 688.821427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.821427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.821427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.821427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.821427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.821427] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2908c9f-8072-4c10-8dc1-601d199c4273 already deleted. [ 688.821427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2908c9f-8072-4c10-8dc1-601d199c4273" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.997475] env[65381]: INFO networking_nsxv3.common.synchronization [req-669ae7af-7318-46e6-b9c5-96f3d53060c1 req-ae4a3182-f2e9-489c-9f73-e4df349042cc tempest-ServerMetadataTestJSON-1695680042 tempest-ServerMetadataTestJSON-1695680042-project-member] Enqueued Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_members [ 688.997475] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGHEST for action security_group_members [ 688.997475] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.997475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.997755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.997919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.998291] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.998291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.998291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.998459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.998459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.999034] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.243018] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.243237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.243324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.243593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.243686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.243898] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.244007] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.244096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.244262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.244341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.244463] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be updated. [ 689.281110] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a89d4d84-7cb2-4c08-be05-40a006a7aba6: rpc.has_security_group_logging(os_id): False [ 689.424170] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.424367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.424416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.424601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.424688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.424943] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.425091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.425188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.425371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425602] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 689.445283] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.446120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.446120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.446120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.446120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.462498] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: IN_PROGRESS for 2s [ 689.501279] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.501485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.501639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.501786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.501881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.502099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.502201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.502266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.502444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.502559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.502653] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a is going to be updated. [ 689.542046] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.542311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.542311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.542933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.542933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.558043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.558043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.558043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.558274] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.558409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.570435] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a in Status: IN_PROGRESS for 2s [ 689.571242] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 689.756773] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad in Status: SUCCESS [ 689.757068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.967415] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a7f447c4-0493-4661-b5c7-c8e0d583e15b None None] Enqueued Resource ID: 8f10c444-872b-401d-8be5-332a0c2a7786 with Priority: HIGHEST for action port [ 690.971033] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f10c444-872b-401d-8be5-332a0c2a7786 with Priority: HIGHEST for action port [ 690.971033] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f10c444-872b-401d-8be5-332a0c2a7786 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.971033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f10c444-872b-401d-8be5-332a0c2a7786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.971033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f10c444-872b-401d-8be5-332a0c2a7786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.971033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f10c444-872b-401d-8be5-332a0c2a7786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.971033] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f10c444-872b-401d-8be5-332a0c2a7786',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.472391] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f10c444-872b-401d-8be5-332a0c2a7786 [ 691.472645] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.472816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.472890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.473195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.473294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.473392] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f10c444-872b-401d-8be5-332a0c2a7786 already deleted. [ 691.473479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f10c444-872b-401d-8be5-332a0c2a7786" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.474588] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 691.474840] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e deletion is rescheduled due to dependency. [ 691.474895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.583126] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a in Status: SUCCESS [ 691.583428] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a deletion is rescheduled due to dependency. [ 691.583606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.586986] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 691.587236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.726797] env[65381]: INFO networking_nsxv3.common.synchronization [req-0547dc52-e8d1-4512-b9e6-e5809fc7de11 req-5bd2e7cb-bed3-4aa9-8557-ea17818c8021 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 692.727366] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 692.727676] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.727789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.728056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.728123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.728277] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.728379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.728444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.728631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.728689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.728766] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.095117] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.095336] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.095458] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.095861] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.096187] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.096434] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.096597] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.096926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.097304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.097424] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.097615] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.097768] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.097961] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.098117] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.098291] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.098473] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.122078] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.122280] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.122465] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.122649] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.122977] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.123283] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.123283] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.123636] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.123835] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed8946b-f797-4bef-b93b-16d3d4fbc9b6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.231043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.231043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.231043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.231291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.231291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.231488] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.231603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.231635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.231793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.231871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.231955] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 already deleted. [ 693.232055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.626732] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.626974] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.627174] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.627482] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.627625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.627782] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 not found, creating... [ 693.628108] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.628215] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.628332] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.628557] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.628690] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.628980] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.629129] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.629242] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.629521] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.629680] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.629818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 is going to be created. [ 693.653659] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.653940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.653940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.654196] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.654419] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.654652] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.403877] env[65381]: INFO networking_nsxv3.common.synchronization [req-0547dc52-e8d1-4512-b9e6-e5809fc7de11 req-76297664-10f5-4e02-ab22-2ed8e3edac2d service nova] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 694.403877] env[65381]: INFO networking_nsxv3.common.synchronization [req-0547dc52-e8d1-4512-b9e6-e5809fc7de11 req-76297664-10f5-4e02-ab22-2ed8e3edac2d service nova] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 694.403877] env[65381]: INFO networking_nsxv3.common.synchronization [req-0547dc52-e8d1-4512-b9e6-e5809fc7de11 req-76297664-10f5-4e02-ab22-2ed8e3edac2d service nova] Enqueued Resource ID: 2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 with Priority: HIGHEST for action port [ 694.403877] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 694.403877] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 694.403877] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 with Priority: HIGHEST for action port [ 694.403877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.403877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.404736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.404736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.404736] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.405600] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.405600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.406931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.406931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.406931] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.406931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.406931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.406931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.406931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.406931] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.407663] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.407663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.407663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.407663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.408328] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed8946b-f797-4bef-b93b-16d3d4fbc9b6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.909907] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.910043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.910241] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.914957] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 with status ACTIVE [ 694.915413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.915413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.915413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.915583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.915668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.915840] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.915938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.915999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.916376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.916462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.916823] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.916823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.916823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.917034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.917135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.917222] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ed8946b-f797-4bef-b93b-16d3d4fbc9b6 is going to be updated. [ 694.939552] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.939714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.939775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.940070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.940222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.940382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ed8946b-f797-4bef-b93b-16d3d4fbc9b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.415416] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.919055] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.919055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.919055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.919055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.919447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.919821] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be created. [ 695.955272] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.955504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.955670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.955950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.957325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.968841] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: UNINITIALIZED for 2s [ 696.417880] env[65381]: INFO networking_nsxv3.common.synchronization [req-979959cd-8e9c-4c91-8254-adcbaad5770a req-e0eb9bb8-b5ce-4519-8c40-6a44dfdccfd0 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 696.417880] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 696.417880] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.417880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.417880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.418503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.418503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.418503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.418503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.418503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.418721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.418721] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.436255] env[65381]: INFO networking_nsxv3.common.synchronization [req-979959cd-8e9c-4c91-8254-adcbaad5770a req-e0eb9bb8-b5ce-4519-8c40-6a44dfdccfd0 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 696.436427] env[65381]: INFO networking_nsxv3.common.synchronization [req-979959cd-8e9c-4c91-8254-adcbaad5770a req-e0eb9bb8-b5ce-4519-8c40-6a44dfdccfd0 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 696.436558] env[65381]: INFO networking_nsxv3.common.synchronization [req-979959cd-8e9c-4c91-8254-adcbaad5770a req-e0eb9bb8-b5ce-4519-8c40-6a44dfdccfd0 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with Priority: HIGHEST for action port [ 696.437197] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_rules [ 696.437509] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 696.437633] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with Priority: HIGHEST for action port [ 696.438304] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.438304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.438304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.438304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.438490] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.439187] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.439278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.439942] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-55234d07-fb90-41b4-b227-6df6d4dd7ac0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.439942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.439942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.439942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.439942] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55234d07-fb90-41b4-b227-6df6d4dd7ac0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.696723] env[65381]: INFO networking_nsxv3.common.synchronization [req-555668a8-c5d3-4abf-b44b-ae6045785fcd req-84f97dd9-8465-4add-943d-9edd061ce7e1 tempest-ServersV294TestFqdnHostnames-1279301147 tempest-ServersV294TestFqdnHostnames-1279301147-project-member] Enqueued Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_members [ 696.697422] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_members [ 696.697422] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.697629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.697629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.698658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.698658] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.698658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.698658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.698658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.698658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.698658] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.921320] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.941578] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.941816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.942024] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55234d07-fb90-41b4-b227-6df6d4dd7ac0 with status ACTIVE [ 696.942198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.942936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.943014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.943230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.943319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.943501] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.943602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.943662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.943819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.943895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.944092] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.944186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.944245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.944382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.944457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.944540] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55234d07-fb90-41b4-b227-6df6d4dd7ac0 is going to be updated. [ 696.968447] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.968585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.968655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.968854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.968987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.969461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55234d07-fb90-41b4-b227-6df6d4dd7ac0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.200515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.200748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.200748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.201018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.201252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.201544] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.201654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.201717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.201867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.201964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.202071] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 already deleted. [ 697.202155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.247035] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.247233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-614" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.247350] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-614" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.247661] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-614" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.247920] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.248222] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.248351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.248782] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.249084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.249319] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.249477] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.249792] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.250032] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.250178] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.250702] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.250702] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.273223] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.273332] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.273396] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.273558] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-614" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.273906] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-0c0367ca-65e2-4317-a241-74175a049de6 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.274199] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.274297] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.274613] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.274842] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c0367ca-65e2-4317-a241-74175a049de6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.424052] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.777280] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.777671] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.777897] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.778192] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.778421] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.778672] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 0c0367ca-65e2-4317-a241-74175a049de6 not found, creating... [ 697.779085] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.779337] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.779594] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.779936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.780162] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.780703] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.781014] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.781126] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.781361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.781547] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.781709] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 0c0367ca-65e2-4317-a241-74175a049de6 is going to be created. [ 697.813979] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.814252] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.814252] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.814736] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.814815] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.815231] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.926175] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.926355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.926430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.926650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.929691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.929691] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 697.968143] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.968344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.968401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.968651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.968799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.992325] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 697.992564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.993180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.993400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.993598] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.993743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.993794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.993957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.994057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.994146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.994239] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.996239] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 698.305779] env[65381]: INFO networking_nsxv3.common.synchronization [req-b586d3c9-8316-4225-9d51-0274ab9f8e01 req-f5e3461e-8c93-4033-8bba-c934ca177d3b tempest-InstanceActionsTestJSON-1769376671 tempest-InstanceActionsTestJSON-1769376671-project-member] Enqueued Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_members [ 698.306330] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGHEST for action security_group_members [ 698.306804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.306804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.306958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.307175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.307361] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.307468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.307534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.307700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.307789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.307903] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.498183] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.499719] env[65381]: INFO networking_nsxv3.common.synchronization [req-555668a8-c5d3-4abf-b44b-ae6045785fcd req-2671a8a1-a8fc-4680-b7f7-7a68c3bc3f94 service nova] Enqueued Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_rules [ 698.499875] env[65381]: INFO networking_nsxv3.common.synchronization [req-555668a8-c5d3-4abf-b44b-ae6045785fcd req-2671a8a1-a8fc-4680-b7f7-7a68c3bc3f94 service nova] Enqueued Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_members [ 698.500021] env[65381]: INFO networking_nsxv3.common.synchronization [req-555668a8-c5d3-4abf-b44b-ae6045785fcd req-2671a8a1-a8fc-4680-b7f7-7a68c3bc3f94 service nova] Enqueued Resource ID: 0c0367ca-65e2-4317-a241-74175a049de6 with Priority: HIGHEST for action port [ 698.504630] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_rules [ 698.505136] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_members [ 698.505267] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c0367ca-65e2-4317-a241-74175a049de6 with Priority: HIGHEST for action port [ 698.505549] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.505695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.506071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.506302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.506385] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.507583] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.507583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.507583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.507583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.507755] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.507796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.507855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.507993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.508085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.508174] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.508914] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c0367ca-65e2-4317-a241-74175a049de6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.509024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.509739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.509739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.509739] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c0367ca-65e2-4317-a241-74175a049de6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.810453] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.810656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.810755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.811044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.811169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.811431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.811698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.811756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.811942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.812111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.812200] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 is going to be updated. [ 698.851904] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.852115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.852161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.852341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.852486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.862926] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 in Status: IN_PROGRESS for 2s [ 699.004491] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915a6b47-7bba-4851-9dc7-06e0692a5259: rpc.has_security_group_logging(os_id): False [ 699.013128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.013265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.013464] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.014418] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c0367ca-65e2-4317-a241-74175a049de6 with status ACTIVE [ 699.014635] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.014724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.014817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.014993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.015093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.015265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.015361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.015422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.015629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.015683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.016460] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.017498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.017579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.017759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.017842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.017932] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c0367ca-65e2-4317-a241-74175a049de6 is going to be updated. [ 699.024472] env[65381]: INFO networking_nsxv3.common.synchronization [req-65dc57ea-d25e-462c-be48-19fe6d49c174 req-9cbfd543-4f2a-43ac-ae96-62791d4e9399 tempest-ServersAdminNegativeTestJSON-218141663 tempest-ServersAdminNegativeTestJSON-218141663-project-member] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 699.026627] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 699.027702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.027822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.027894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.028121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.028213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.028458] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.028631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.028631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.028763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.028837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.028920] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be created. [ 699.030538] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.030647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.030714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.030931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.031097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.031198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.031260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.031403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.031479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.031613] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.044941] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.044941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.044941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.045427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.045773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.046609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c0367ca-65e2-4317-a241-74175a049de6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.092707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.092869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.092944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.093180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.093431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.107386] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 699.524441] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.535208] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.535208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.535208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.536278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.536278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.536412] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.536473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.536675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.536829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.537013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.537104] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc already deleted. [ 699.537190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.604256] env[65381]: INFO networking_nsxv3.common.synchronization [req-d9bdb8b8-1c2b-4ed6-90cb-1a28f523de44 req-cfab793f-a9e7-46d7-b4ad-b58685e84a2d tempest-VolumesAssistedSnapshotsTest-911230567 tempest-VolumesAssistedSnapshotsTest-911230567-project-member] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_members [ 699.604716] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGHEST for action security_group_members [ 699.605052] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.605191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.605244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.605449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.605641] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.605727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.605763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.605907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.605994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.606103] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.884794] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.884987] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.885122] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.885398] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.885737] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.885983] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.885983] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.886218] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.886352] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.886551] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.886656] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.886776] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.886848] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.886949] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.887064] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.887190] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.908627] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.908778] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.908916] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.909110] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.909476] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-d195f32e-8668-46ce-9db7-6f4064c11a45 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.909663] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.910202] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.910202] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.910326] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d195f32e-8668-46ce-9db7-6f4064c11a45',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.008540] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 700.008540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.008745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.008951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.009434] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.009434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.009552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.009671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.009775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.009878] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.027159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.027469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.027553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.027765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.027855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.027952] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 is going to be created. [ 700.054843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.054968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.055065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.055352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.055567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.067150] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 in Status: UNINITIALIZED for 2s [ 700.108760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.108919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.108984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.109218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.109389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.109541] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.109628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.109689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.109819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.109893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.109978] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c2d48d-c321-4e23-999d-809958401c70 is going to be updated. [ 700.143158] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.143331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.143376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.143584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.143729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.154418] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c2d48d-c321-4e23-999d-809958401c70 in Status: IN_PROGRESS for 2s [ 700.412777] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.413203] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.413371] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.413654] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.413802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.414193] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port d195f32e-8668-46ce-9db7-6f4064c11a45 not found, creating... [ 700.414481] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.414644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.414758] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.414980] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.415125] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.415419] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.415590] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.415704] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.415906] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.416150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.416327] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: d195f32e-8668-46ce-9db7-6f4064c11a45 is going to be created. [ 700.442801] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.443327] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.443477] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.444212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.444560] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.449017] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.514611] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.876285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 in Status: SUCCESS [ 700.876670] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 deletion is rescheduled due to dependency. [ 700.876670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.018906] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.123624] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 701.123624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.180201] env[65381]: INFO networking_nsxv3.common.synchronization [req-65dc57ea-d25e-462c-be48-19fe6d49c174 req-0ff69393-ae2e-41b1-a3c3-e08c9877dbab service nova] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_rules [ 701.180392] env[65381]: INFO networking_nsxv3.common.synchronization [req-65dc57ea-d25e-462c-be48-19fe6d49c174 req-0ff69393-ae2e-41b1-a3c3-e08c9877dbab service nova] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 701.180528] env[65381]: INFO networking_nsxv3.common.synchronization [req-65dc57ea-d25e-462c-be48-19fe6d49c174 req-0ff69393-ae2e-41b1-a3c3-e08c9877dbab service nova] Enqueued Resource ID: d195f32e-8668-46ce-9db7-6f4064c11a45 with Priority: HIGHEST for action port [ 701.181126] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_rules [ 701.181264] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 701.181386] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d195f32e-8668-46ce-9db7-6f4064c11a45 with Priority: HIGHEST for action port [ 701.181687] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.181803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.181869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.185384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.185480] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.188403] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.188566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.188629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.188832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.189332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.189332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.189418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.189561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.189614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.189711] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.191120] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d195f32e-8668-46ce-9db7-6f4064c11a45 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.191532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.191532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.191532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.191532] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d195f32e-8668-46ce-9db7-6f4064c11a45',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.403357] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b9293710-7336-4d16-a4b0-84d2d0ea583f None None] Enqueued Resource ID: 8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe with Priority: HIGHEST for action port [ 701.403901] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe with Priority: HIGHEST for action port [ 701.404207] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.404322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.404385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.404636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.404716] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.522031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.522202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.522273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.522584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.522658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.522686] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 701.552250] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.552412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.552488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.552724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.552874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.564215] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 701.688829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.689025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.691335] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.692861] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d195f32e-8668-46ce-9db7-6f4064c11a45 with status ACTIVE [ 701.693185] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.693276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.693403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.693538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.693645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.694406] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.694406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.694406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.694406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.694406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.694587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.694587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.694717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.694821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.694891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.695015] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d195f32e-8668-46ce-9db7-6f4064c11a45 is going to be updated. [ 701.717386] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.717607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.717607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.717799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.718044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.718143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d195f32e-8668-46ce-9db7-6f4064c11a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.907445] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe [ 701.907445] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.907445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.907445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.908138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.908138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.908138] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe already deleted. [ 701.908138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c724bc4-77b5-4ba1-8bab-1ab5382f2bfe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.080209] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 in Status: SUCCESS [ 702.080403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.081685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.082791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.085215] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.085348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.085427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.085740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.086410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.086410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.086410] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.166997] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61c2d48d-c321-4e23-999d-809958401c70 in Status: SUCCESS [ 702.166997] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61c2d48d-c321-4e23-999d-809958401c70 deletion is rescheduled due to dependency. [ 702.166997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.193592] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.228595] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-ea9e49c0-acd5-4796-b6d3-ee8c658fce10 tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 702.229479] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 702.229479] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.229671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.229671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.230358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.230612] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.230844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.230946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.231177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.231267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.233146] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.530025] env[65381]: INFO networking_nsxv3.common.synchronization [None req-50a3fd57-fc37-4c91-a857-8c74ba468f0d None None] Enqueued Resource ID: ee2c27f6-629a-44f8-8893-2a89ddb941fe with Priority: HIGHEST for action port [ 702.530025] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2c27f6-629a-44f8-8893-2a89ddb941fe with Priority: HIGHEST for action port [ 702.530201] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee2c27f6-629a-44f8-8893-2a89ddb941fe taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.530276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee2c27f6-629a-44f8-8893-2a89ddb941fe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.530276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee2c27f6-629a-44f8-8893-2a89ddb941fe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.530529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee2c27f6-629a-44f8-8893-2a89ddb941fe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.530608] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2c27f6-629a-44f8-8893-2a89ddb941fe',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.591387] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.699787] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.699787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.699925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.700139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.700238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.700355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be created. [ 702.730306] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.730306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.730306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.730306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.730306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.734293] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.734470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.734470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.734732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.734801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.735082] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.735172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.735235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.735420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.735514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.735609] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 already deleted. [ 702.735748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.744303] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: UNINITIALIZED for 2s [ 703.035719] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee2c27f6-629a-44f8-8893-2a89ddb941fe [ 703.035969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.036082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.036592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.036592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.036592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.036592] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee2c27f6-629a-44f8-8893-2a89ddb941fe already deleted. [ 703.036592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee2c27f6-629a-44f8-8893-2a89ddb941fe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.095294] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b334e63-c2b8-4d02-9110-c8fc60d33c13: rpc.has_security_group_logging(os_id): False [ 703.118766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.118766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.118766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.119242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.119242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.119696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.119696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.119696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.119890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.121054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.121054] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 is going to be created. [ 703.189344] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.189545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.189591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.189879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.189960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.208182] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 in Status: IN_PROGRESS for 2s [ 703.444357] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.444547] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.444666] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.444998] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.445262] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.445415] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.445526] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.445734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.449101] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.449101] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.449101] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.449101] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.449101] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.449101] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.449101] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.449101] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.469082] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.469082] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.469082] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.469082] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.470253] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-1685dffa-08c6-45eb-838b-28016c488bea taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.470253] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.470253] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.470253] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.470253] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1685dffa-08c6-45eb-838b-28016c488bea',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.575241] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 703.575500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.575674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.575895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.576109] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.576227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.576312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.576439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.576518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.576604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.576721] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.774692] env[65381]: INFO networking_nsxv3.common.synchronization [None req-59af232d-0258-482b-82d8-6cff4f6035bc None None] Enqueued Resource ID: c59c7d5d-bc11-420b-895e-4f09b96d1fa7 with Priority: HIGHEST for action port [ 703.775732] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59c7d5d-bc11-420b-895e-4f09b96d1fa7 with Priority: HIGHEST for action port [ 703.775732] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c59c7d5d-bc11-420b-895e-4f09b96d1fa7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.775855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c59c7d5d-bc11-420b-895e-4f09b96d1fa7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.775855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c59c7d5d-bc11-420b-895e-4f09b96d1fa7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.776110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c59c7d5d-bc11-420b-895e-4f09b96d1fa7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.776224] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c59c7d5d-bc11-420b-895e-4f09b96d1fa7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.790720] env[65381]: INFO networking_nsxv3.common.synchronization [None req-fce0ff94-29d6-46ba-9fb5-a1d2c62a9af6 None None] Enqueued Resource ID: c3527779-d248-4c80-aa55-637bedad5826 with Priority: HIGHEST for action port [ 703.790992] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3527779-d248-4c80-aa55-637bedad5826 with Priority: HIGHEST for action port [ 703.791606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3527779-d248-4c80-aa55-637bedad5826 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.791808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3527779-d248-4c80-aa55-637bedad5826" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.791808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3527779-d248-4c80-aa55-637bedad5826" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.793166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3527779-d248-4c80-aa55-637bedad5826" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.793277] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3527779-d248-4c80-aa55-637bedad5826',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.973761] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.974794] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.974794] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.974794] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.974794] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.974995] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 1685dffa-08c6-45eb-838b-28016c488bea not found, creating... [ 703.975328] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.975537] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.975695] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.975987] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.976185] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.976576] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.976783] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.976954] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.977244] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.977539] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.977731] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 1685dffa-08c6-45eb-838b-28016c488bea is going to be created. [ 703.997821] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.997821] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.998061] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.999025] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.999025] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.999025] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.081830] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.281835] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c59c7d5d-bc11-420b-895e-4f09b96d1fa7 [ 704.282123] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.282283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.282326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.282868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.282868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.282868] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c59c7d5d-bc11-420b-895e-4f09b96d1fa7 already deleted. [ 704.282868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c59c7d5d-bc11-420b-895e-4f09b96d1fa7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.299826] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3527779-d248-4c80-aa55-637bedad5826 [ 704.300058] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.300182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.300246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.300523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.300612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.300711] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3527779-d248-4c80-aa55-637bedad5826 already deleted. [ 704.300788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3527779-d248-4c80-aa55-637bedad5826" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.586043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a89d4d84-7cb2-4c08-be05-40a006a7aba6: rpc.has_security_group_logging(os_id): False [ 704.604546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.604546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.604546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.604546] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 704.669581] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.669581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.669581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.669581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.669581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.687809] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 704.757434] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 704.757596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.757771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.757988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.758204] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.758332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.758472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.758596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.758727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.759082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.759082] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.802358] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-f536c6be-4c31-4a1d-8565-f86322d71693 service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 704.802591] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-f536c6be-4c31-4a1d-8565-f86322d71693 service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 704.802737] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-f536c6be-4c31-4a1d-8565-f86322d71693 service nova] Enqueued Resource ID: 1685dffa-08c6-45eb-838b-28016c488bea with Priority: HIGHEST for action port [ 704.803308] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 704.803447] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 704.804788] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1685dffa-08c6-45eb-838b-28016c488bea with Priority: HIGHEST for action port [ 704.805145] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.805284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.805353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.806689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.807040] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.810351] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.810351] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.810351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.810351] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.812057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-1685dffa-08c6-45eb-838b-28016c488bea taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.812187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.812269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.812424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.812503] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1685dffa-08c6-45eb-838b-28016c488bea',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.818687] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-cc49483f-1392-44df-bb92-f816e437a8a3 tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 704.819334] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 704.819709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.819814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.880626] env[65381]: INFO networking_nsxv3.common.synchronization [None req-33b137dc-bc18-4aef-beff-eb1e67a36292 None None] Enqueued Resource ID: 215c7fd7-e905-43ed-b3bd-574b24828d78 with Priority: HIGHEST for action port [ 704.882023] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215c7fd7-e905-43ed-b3bd-574b24828d78 with Priority: HIGHEST for action port [ 704.882148] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-215c7fd7-e905-43ed-b3bd-574b24828d78 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.882548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-215c7fd7-e905-43ed-b3bd-574b24828d78" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.882548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-215c7fd7-e905-43ed-b3bd-574b24828d78" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.883282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-215c7fd7-e905-43ed-b3bd-574b24828d78" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.883282] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('215c7fd7-e905-43ed-b3bd-574b24828d78',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.226565] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 in Status: SUCCESS [ 705.226565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.234604] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.234604] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.234604] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.234604] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.234937] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.235091] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.235208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.235425] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.235567] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.235765] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.235870] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.235967] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.237662] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.237818] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.237932] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.238077] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.257307] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.257453] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.257582] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.257740] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.258060] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-2c661f6f-d65e-43d9-ab21-2999c630b669 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.258222] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.258761] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.258761] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.258761] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c661f6f-d65e-43d9-ab21-2999c630b669',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.262510] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.262673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.262798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.262906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.263171] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.263171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.263290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.263363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.263444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.263587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.266734] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.266734] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.266734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.266734] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.314536] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.315509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.317107] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.318135] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1685dffa-08c6-45eb-838b-28016c488bea with status ACTIVE [ 705.318870] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.319059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.319140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.319354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.319495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.319635] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.319734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.319801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.320023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.320104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.320309] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.320406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.320469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.320608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.320685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.320764] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1685dffa-08c6-45eb-838b-28016c488bea is going to be updated. [ 705.348230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.348616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.348728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.348997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.349109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.349271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1685dffa-08c6-45eb-838b-28016c488bea" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.384771] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 215c7fd7-e905-43ed-b3bd-574b24828d78 [ 705.385270] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.385419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.385489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.385699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.385789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.385881] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:215c7fd7-e905-43ed-b3bd-574b24828d78 already deleted. [ 705.385960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-215c7fd7-e905-43ed-b3bd-574b24828d78" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.485427] env[65381]: INFO networking_nsxv3.common.synchronization [req-1332bc6f-3d2f-4993-a6a2-8a9d00a9c6b5 req-558d59f5-0478-4c55-bb11-23a599cd71ee tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 705.485427] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 705.485713] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.485903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.485970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.486290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.486956] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.487898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.487978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.488175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.488263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.488364] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.764148] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.764425] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.764565] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.764875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.765056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.765218] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 2c661f6f-d65e-43d9-ab21-2999c630b669 not found, creating... [ 705.765511] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.765696] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.765838] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.766101] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.766267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.766981] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.766981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.766981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.767204] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.767394] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.767526] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 2c661f6f-d65e-43d9-ab21-2999c630b669 is going to be created. [ 705.769175] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc: rpc.has_security_group_logging(os_id): False [ 705.791196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.791475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.791475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.791879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.791972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.792199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.792318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.792359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.792539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.792898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.792898] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.792898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.793076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.793235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.793313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.793491] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.793585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.793648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.793799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.793875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.793960] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be created. [ 705.811339] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.811689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.813206] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.813206] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.813206] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.813206] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.825498] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.896963] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.897258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.897258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.897430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.897812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.914420] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 705.936881] env[65381]: INFO networking_nsxv3.common.synchronization [None req-7f7559ae-e4ce-40e4-b0f4-a289c1d32964 None None] Enqueued Resource ID: 451ecbe0-f486-40f6-8951-5ce0261e3db9 with Priority: HIGHEST for action port [ 705.937441] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 451ecbe0-f486-40f6-8951-5ce0261e3db9 with Priority: HIGHEST for action port [ 705.937794] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-451ecbe0-f486-40f6-8951-5ce0261e3db9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.937925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-451ecbe0-f486-40f6-8951-5ce0261e3db9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.938011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-451ecbe0-f486-40f6-8951-5ce0261e3db9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.938299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-451ecbe0-f486-40f6-8951-5ce0261e3db9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.938378] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('451ecbe0-f486-40f6-8951-5ce0261e3db9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.993739] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.227471] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-935 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.227471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.227471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.227471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.227471] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.227471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.227471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.228086] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.228086] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.228086] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.228086] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.228086] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.228218] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.228248] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.228355] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.228450] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.251305] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.251593] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.251671] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.251845] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-935" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.252184] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-3cb771fc-760d-4906-9314-8dac014a4679 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.252354] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.252466] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.252832] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.252972] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb771fc-760d-4906-9314-8dac014a4679',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.332547] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.332748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.332864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.333135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.333237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.333338] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be created. [ 706.360804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.361049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.361049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.361232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.361396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.372535] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: UNINITIALIZED for 2s [ 706.443756] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 451ecbe0-f486-40f6-8951-5ce0261e3db9 [ 706.443863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.443970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.444039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.444390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.444868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.444868] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:451ecbe0-f486-40f6-8951-5ce0261e3db9 already deleted. [ 706.444868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-451ecbe0-f486-40f6-8951-5ce0261e3db9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.497105] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.517247] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-942b6887-1a5e-4e48-b2db-9a431014bbbf service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 706.517247] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-942b6887-1a5e-4e48-b2db-9a431014bbbf service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 706.517247] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0528edf-82fb-4e11-b40f-13fe288cbc06 req-942b6887-1a5e-4e48-b2db-9a431014bbbf service nova] Enqueued Resource ID: 2c661f6f-d65e-43d9-ab21-2999c630b669 with Priority: HIGHEST for action port [ 706.517247] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 706.517247] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 706.517247] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c661f6f-d65e-43d9-ab21-2999c630b669 with Priority: HIGHEST for action port [ 706.517247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.517247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.517247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.517247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.517247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c661f6f-d65e-43d9-ab21-2999c630b669 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.517697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.517877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.518247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.518400] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c661f6f-d65e-43d9-ab21-2999c630b669',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.707437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 706.707644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.760954] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.761200] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.761382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.761635] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.761788] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.761939] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 3cb771fc-760d-4906-9314-8dac014a4679 not found, creating... [ 706.762214] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.762369] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.762480] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.762706] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.762835] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.763124] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.763278] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.763386] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.763700] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.763843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.764018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 3cb771fc-760d-4906-9314-8dac014a4679 is going to be created. [ 706.812816] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.813058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.813114] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.813382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.813605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.813832] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.000431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.000431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.000431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.000745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.000745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.000745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 707.020945] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c661f6f-d65e-43d9-ab21-2999c630b669 with status ACTIVE [ 707.021073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.021140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.021204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.021528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.021528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.021849] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.021976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.022058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.022231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.022314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.022509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.022630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.022700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.022904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.022948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.023011] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c661f6f-d65e-43d9-ab21-2999c630b669 is going to be updated. [ 707.041489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.041699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.042029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.042029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.042118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.051237] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 707.052159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.052286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.052356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.052565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.052752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.052914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c661f6f-d65e-43d9-ab21-2999c630b669" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.103192] env[65381]: INFO networking_nsxv3.common.synchronization [req-113716d2-5a19-4f94-b2eb-bd45073b1089 req-393732a7-874c-4606-a056-514f37761b90 tempest-InstanceActionsV221TestJSON-1368179132 tempest-InstanceActionsV221TestJSON-1368179132-project-member] Enqueued Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_members [ 707.103756] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGHEST for action security_group_members [ 707.104112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.104229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.104296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.104756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.104756] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.104756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.104904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.104945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.105720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.105720] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.520863] env[65381]: INFO networking_nsxv3.common.synchronization [req-1332bc6f-3d2f-4993-a6a2-8a9d00a9c6b5 req-59ec054f-c737-4f92-a30d-5efcb0d0ba2c service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 707.520863] env[65381]: INFO networking_nsxv3.common.synchronization [req-1332bc6f-3d2f-4993-a6a2-8a9d00a9c6b5 req-59ec054f-c737-4f92-a30d-5efcb0d0ba2c service nova] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 707.520863] env[65381]: INFO networking_nsxv3.common.synchronization [req-1332bc6f-3d2f-4993-a6a2-8a9d00a9c6b5 req-59ec054f-c737-4f92-a30d-5efcb0d0ba2c service nova] Enqueued Resource ID: 3cb771fc-760d-4906-9314-8dac014a4679 with Priority: HIGHEST for action port [ 707.521748] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_rules [ 707.521894] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 707.521993] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb771fc-760d-4906-9314-8dac014a4679 with Priority: HIGHEST for action port [ 707.522288] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.522411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.522476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.522725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.522811] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.523783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.523880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.524084] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb771fc-760d-4906-9314-8dac014a4679 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.524187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.524248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.524430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.524507] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb771fc-760d-4906-9314-8dac014a4679',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.608669] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.609364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.609364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.609364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.609364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.609524] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.609524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.609524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.609674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.609739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.609832] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad is going to be updated. [ 707.645072] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.648048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.648048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.648048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.648048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.686075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad in Status: IN_PROGRESS for 2s [ 707.930454] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 707.930876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.027234] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cb771fc-760d-4906-9314-8dac014a4679 with status ACTIVE [ 708.027234] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.027234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.027234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.027234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.027234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.027642] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.027642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.027642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.027932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.028050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.028318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.028467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.028518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.028646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.028737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.028820] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cb771fc-760d-4906-9314-8dac014a4679 is going to be updated. [ 708.030206] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.030206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.059166] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.059365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.059428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.059749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.060107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.060286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb771fc-760d-4906-9314-8dac014a4679" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.385591] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 708.385591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.385791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.385957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.386495] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.386495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.386495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.386651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.386651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.386703] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.890718] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.063661] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 709.063917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.064155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.064705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.064705] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.064846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.064846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.065046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.065130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.065238] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.393349] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.569454] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.702513] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad in Status: SUCCESS [ 709.703063] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad deletion is rescheduled due to dependency. [ 709.703252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.873228] env[65381]: INFO networking_nsxv3.common.synchronization [req-d30db5ff-fe59-4698-a67f-322810c408f1 req-0d3b867f-f12a-4127-a4bb-c535c1edb351 tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 with Priority: HIGHEST for action security_group_rules [ 709.873877] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 with Priority: HIGHEST for action security_group_rules [ 709.874349] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4457198a-6a29-4fa4-9562-10bfd62f7458 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.874483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.874547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.874802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.875178] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4457198a-6a29-4fa4-9562-10bfd62f7458',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.899039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.899039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.899039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.899039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.899039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.899039] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 709.930598] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.930736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.930805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.931021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.931163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.943884] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 710.073776] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.403592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.403781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.403781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.404041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.404135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.404231] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 already deleted. [ 710.404313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.576038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.576038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.576038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.576038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.576038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.576320] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 710.632439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.632618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.632687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.633045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.634495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.655946] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 710.906843] env[65381]: INFO networking_nsxv3.common.synchronization [req-6205a583-51c8-4796-b557-8aac66a4e36d req-97cf4779-4e0b-4db5-bc26-621116109df8 tempest-ServerPasswordTestJSON-1929152057 tempest-ServerPasswordTestJSON-1929152057-project-member] Enqueued Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_members [ 710.907635] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGHEST for action security_group_members [ 710.908130] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.908268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.908330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.908596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.908783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.908893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.908954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.910423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.910535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.912215] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.418229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.418480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.418480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.418726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.418852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.419071] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.419174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.419348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.419524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.419870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.419870] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd is going to be updated. [ 711.455489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.455662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.455704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.455902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.456055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.466585] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd in Status: IN_PROGRESS for 2s [ 711.959035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 711.959035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.959035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.959035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.959035] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.959035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.959035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.960505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.961164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.961946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.963026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.963484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.963839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.965578] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.965578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.965578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.965578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.965578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.965578] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.469511] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.469647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.470814] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.608128] env[65381]: INFO networking_nsxv3.common.synchronization [None req-81634371-d681-4549-b6e0-64d4fe31e3ce None None] Enqueued Resource ID: 25713a05-5b23-4178-a35c-662d6bae6b58 with Priority: HIGHEST for action port [ 712.608128] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25713a05-5b23-4178-a35c-662d6bae6b58 with Priority: HIGHEST for action port [ 712.608128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-25713a05-5b23-4178-a35c-662d6bae6b58 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.608128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25713a05-5b23-4178-a35c-662d6bae6b58" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.608128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25713a05-5b23-4178-a35c-662d6bae6b58" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.608626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25713a05-5b23-4178-a35c-662d6bae6b58" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.608626] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25713a05-5b23-4178-a35c-662d6bae6b58',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.666794] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 712.667155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.667238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.667456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.667648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.667754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.667823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.667969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.668064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.668241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.668241] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.972911] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.112301] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25713a05-5b23-4178-a35c-662d6bae6b58 [ 713.112301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.112301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.112301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.112301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.112301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.112301] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25713a05-5b23-4178-a35c-662d6bae6b58 already deleted. [ 713.112301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25713a05-5b23-4178-a35c-662d6bae6b58" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.170642] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.170848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.170848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.171120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.171336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.171483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.171585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.171885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.172023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.172204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.172470] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.172621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.172679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.172948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.173110] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.173263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.173715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.173939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.174039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.174682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.174682] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.430455] env[65381]: INFO networking_nsxv3.common.synchronization [req-e8452984-558d-4cf3-912c-7daa40044449 req-d157b531-e90d-470b-9545-a094d99304d4 tempest-AttachInterfacesUnderV243Test-1672495803 tempest-AttachInterfacesUnderV243Test-1672495803-project-member] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 713.430976] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGHEST for action security_group_members [ 713.432625] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.433137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.433214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.433444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.433632] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.433717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.433778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.433963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.434055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.434162] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.477134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.477315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.477406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.477690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.478611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.478611] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 713.482507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd in Status: SUCCESS [ 713.482734] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd deletion is rescheduled due to dependency. [ 713.482829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.510427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.510641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.510641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.510919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.512105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.522183] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 713.683680] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca1b5748-90c1-473a-ab4f-767cc4ab05d7: rpc.has_security_group_logging(os_id): False [ 713.705869] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.705869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.705977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.706181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.706273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.706481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.706581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.706657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.706811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.706889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.707103] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.707212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.707270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.707412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.707495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.707698] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.707794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.707853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.708012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.708490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.708638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 713.792277] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.792277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.792277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.792277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.792277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.803855] env[65381]: INFO networking_nsxv3.common.synchronization [req-6343c9dd-9a5f-4bb2-a65f-9a8bca63a317 req-588240be-4398-4d44-9545-bc0943d18b0c tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 with Priority: HIGHEST for action security_group_rules [ 713.804707] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 with Priority: HIGHEST for action security_group_rules [ 713.805718] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4457198a-6a29-4fa4-9562-10bfd62f7458 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.806649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.806649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.806649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.806649] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4457198a-6a29-4fa4-9562-10bfd62f7458',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.808774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 713.936476] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.936737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.936805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.937027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.937117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.937309] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.937409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.937467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.937616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.937687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.937767] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be updated. [ 713.966666] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.966908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.967014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.967207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.967387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.979604] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: IN_PROGRESS for 2s [ 714.329346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.329530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.329601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.329819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.329935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.330049] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 already deleted. [ 714.330372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.590605] env[65381]: INFO networking_nsxv3.common.synchronization [None req-195bbc86-b912-4095-b13d-a7dbec74bfef None None] Enqueued Resource ID: 532a151e-6e98-400c-94cd-75c0c0fd0ad0 with Priority: HIGHEST for action port [ 714.591183] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 532a151e-6e98-400c-94cd-75c0c0fd0ad0 with Priority: HIGHEST for action port [ 714.591487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-532a151e-6e98-400c-94cd-75c0c0fd0ad0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.591611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-532a151e-6e98-400c-94cd-75c0c0fd0ad0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.591813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-532a151e-6e98-400c-94cd-75c0c0fd0ad0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.591964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-532a151e-6e98-400c-94cd-75c0c0fd0ad0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.599912] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('532a151e-6e98-400c-94cd-75c0c0fd0ad0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.100565] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 532a151e-6e98-400c-94cd-75c0c0fd0ad0 [ 715.100975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.101215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.101293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.101508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.101596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.101731] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:532a151e-6e98-400c-94cd-75c0c0fd0ad0 already deleted. [ 715.101816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-532a151e-6e98-400c-94cd-75c0c0fd0ad0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.538862] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 715.539189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.539265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.541395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.541626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.541779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.541851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.542050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.542139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.542234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.542396] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.542500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.542555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.542701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.542877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.542950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.542986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.543208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.543290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.543372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.543465] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.566956] env[65381]: INFO networking_nsxv3.common.synchronization [None req-cd7ca3a1-ead5-4345-b22a-a6896d1c3be7 None None] Enqueued Resource ID: 7981a1d6-2d87-4ace-b934-9c021c6b1d8b with Priority: HIGHEST for action port [ 715.566956] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7981a1d6-2d87-4ace-b934-9c021c6b1d8b with Priority: HIGHEST for action port [ 715.567338] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7981a1d6-2d87-4ace-b934-9c021c6b1d8b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.567465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7981a1d6-2d87-4ace-b934-9c021c6b1d8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.567531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7981a1d6-2d87-4ace-b934-9c021c6b1d8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.567786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7981a1d6-2d87-4ace-b934-9c021c6b1d8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.567866] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7981a1d6-2d87-4ace-b934-9c021c6b1d8b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.826476] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 715.828027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.990896] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 in Status: SUCCESS [ 715.991746] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 deletion is rescheduled due to dependency. [ 715.991746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.050034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36c26613-3a87-42fa-8ca3-452389ee3bb3: rpc.has_security_group_logging(os_id): False [ 716.078024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.078024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.078024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.078024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.078931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.083031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.083031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.083031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.083031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.083031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.083031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.083031] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be created. [ 716.085136] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7981a1d6-2d87-4ace-b934-9c021c6b1d8b [ 716.085381] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.085736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.085736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.085881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.085933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.086145] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7981a1d6-2d87-4ace-b934-9c021c6b1d8b already deleted. [ 716.086145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7981a1d6-2d87-4ace-b934-9c021c6b1d8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.148292] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.148592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.148592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.148808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.148961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.162976] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 717.090211] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e897a648-6fe6-4161-a3f7-b0d6f3053160 None None] Enqueued Resource ID: b50df497-057b-492f-928d-45bb151eb644 with Priority: HIGHEST for action port [ 717.090328] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b50df497-057b-492f-928d-45bb151eb644 with Priority: HIGHEST for action port [ 717.091505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b50df497-057b-492f-928d-45bb151eb644 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.091819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b50df497-057b-492f-928d-45bb151eb644" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.095150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b50df497-057b-492f-928d-45bb151eb644" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.095482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b50df497-057b-492f-928d-45bb151eb644" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.095889] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b50df497-057b-492f-928d-45bb151eb644',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.164694] env[65381]: INFO networking_nsxv3.common.synchronization [req-012d2278-c0a5-43be-88eb-099686a8ef27 req-4aa344ff-737b-4e4d-8f1c-4b8ad6fd6533 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 717.165642] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 717.165642] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.165771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.165880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.166069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.166321] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.166432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.166495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.167560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.167560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.167560] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.582847] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.582847] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.582847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.582847] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.582847] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.582847] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.582847] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.583628] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.583628] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.583628] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.597284] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b50df497-057b-492f-928d-45bb151eb644 [ 717.598336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.598336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.598336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.598336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.598336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.598336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b50df497-057b-492f-928d-45bb151eb644 already deleted. [ 717.598590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b50df497-057b-492f-928d-45bb151eb644" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.608906] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.609089] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.609269] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.609495] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-997" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.609834] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-6ed4340d-47ce-4ce5-b006-36892b427798 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.610016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.610154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.610473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.610607] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed4340d-47ce-4ce5-b006-36892b427798',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.670212] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.114631] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.114853] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.114974] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.119026] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 6ed4340d-47ce-4ce5-b006-36892b427798 not found, creating... [ 718.119026] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.119026] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.119026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.119471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.119471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.119471] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.119471] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 6ed4340d-47ce-4ce5-b006-36892b427798 is going to be created. [ 718.137390] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.137572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.137692] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.137951] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.138186] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.138394] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.172425] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.174287] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 718.174481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.174690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.175021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.175184] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.677219] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.677421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.677503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.677777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.677777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.677879] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 718.680033] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.680033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.680033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.680033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.681020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.681145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.681202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.681418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.681469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.681592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.681778] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.719968] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.719968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.719968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.719968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.719968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.732499] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 718.892196] env[65381]: INFO networking_nsxv3.common.synchronization [req-012d2278-c0a5-43be-88eb-099686a8ef27 req-52d68362-4cff-46f8-a27e-17773d7cdc45 service nova] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 718.892284] env[65381]: INFO networking_nsxv3.common.synchronization [req-012d2278-c0a5-43be-88eb-099686a8ef27 req-52d68362-4cff-46f8-a27e-17773d7cdc45 service nova] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 718.892385] env[65381]: INFO networking_nsxv3.common.synchronization [req-012d2278-c0a5-43be-88eb-099686a8ef27 req-52d68362-4cff-46f8-a27e-17773d7cdc45 service nova] Enqueued Resource ID: 6ed4340d-47ce-4ce5-b006-36892b427798 with Priority: HIGHEST for action port [ 718.892977] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 718.893240] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 718.893363] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed4340d-47ce-4ce5-b006-36892b427798 with Priority: HIGHEST for action port [ 718.893845] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.894062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.894194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.894402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.894482] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.895417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.895514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.897627] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed4340d-47ce-4ce5-b006-36892b427798 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.898224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.898315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.898514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.900736] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed4340d-47ce-4ce5-b006-36892b427798',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.185973] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.186331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.186331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.186540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.186935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.186935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.187099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.187268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.187382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.187508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.187694] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.187798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.187861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.188020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.188249] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.188249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.188333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.188441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.188518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.188598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.188694] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.401950] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.402219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.402311] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ed4340d-47ce-4ce5-b006-36892b427798 with status ACTIVE [ 719.402486] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.402603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.403662] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.403662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.404208] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.404208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.404208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.404208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.404208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.404208] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ed4340d-47ce-4ce5-b006-36892b427798 is going to be updated. [ 719.431906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.431906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.431906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.431906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.431906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.432245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.693745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36c26613-3a87-42fa-8ca3-452389ee3bb3: rpc.has_security_group_logging(os_id): False [ 719.714996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.715202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.715278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.715513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.715625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.716030] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.716030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.716030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.716209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.716306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.716465] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.716561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.716623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.716792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.716947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.718410] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.718410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.718410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.718410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.718410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.718410] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 719.799997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.799997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.799997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.799997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.800292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.819749] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 720.141369] env[65381]: INFO networking_nsxv3.common.synchronization [req-0ef0a52e-0e06-46bb-a6b3-78c6acc086b3 req-2e97b569-61b3-454a-8e47-6b141f2761e2 tempest-ServersTestBootFromVolume-545680696 tempest-ServersTestBootFromVolume-545680696-project-member] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_members [ 720.141935] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_members [ 720.142521] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.142642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.142724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.143047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.143219] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.143327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.143391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.143549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.143635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.143735] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.273650] env[65381]: INFO networking_nsxv3.common.synchronization [req-e1f32b34-c020-44d2-b501-c1a85dfe39a8 req-896b71b8-9907-4f9a-893c-8dd196768615 tempest-SecurityGroupRulesTestJSON-1950266343 tempest-SecurityGroupRulesTestJSON-1950266343-project-member] Enqueued Resource ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 with Priority: HIGHEST for action security_group_rules [ 720.274354] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 with Priority: HIGHEST for action security_group_rules [ 720.274692] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4457198a-6a29-4fa4-9562-10bfd62f7458 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.274872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.274927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.275501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.275633] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4457198a-6a29-4fa4-9562-10bfd62f7458',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.525529] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-244 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.525775] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-244" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.525931] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-244" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.526272] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-244" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.529046] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.529046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.529046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.529046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.529046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.529046] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.529046] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.529046] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.529046] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.529046] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.529046] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.529046] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.549837] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.549837] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.549837] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.550010] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-244" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.550359] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-77522d3c-8cc7-43e4-b860-31d05925d891 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.550540] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.550630] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.551029] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.551323] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77522d3c-8cc7-43e4-b860-31d05925d891',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.645594] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.645751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.645819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.646092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.646315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.646315] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.646482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.646482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.646663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.646788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.646895] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 already deleted. [ 720.646978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.746948] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 720.748020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.748591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.748739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.748963] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.749122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.749193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.749366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.749453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.749555] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.809969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.810169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.810208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.810840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.810840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.810840] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4457198a-6a29-4fa4-9562-10bfd62f7458 already deleted. [ 720.810840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4457198a-6a29-4fa4-9562-10bfd62f7458" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.054727] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.054727] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.054727] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.055121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.055334] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.055560] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 77522d3c-8cc7-43e4-b860-31d05925d891 not found, creating... [ 721.055959] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.056199] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.056428] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.056740] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.056872] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.057305] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.057524] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.057686] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.057981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.058181] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.058523] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 77522d3c-8cc7-43e4-b860-31d05925d891 is going to be created. [ 721.083042] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.083295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.083392] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.083997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.083997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.084373] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.252741] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.755726] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.838977] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 721.839371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.902514] env[65381]: INFO networking_nsxv3.common.synchronization [req-0ef0a52e-0e06-46bb-a6b3-78c6acc086b3 req-4e2ae229-5825-4e42-b1c6-60dbaca60d5e service nova] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_rules [ 721.902796] env[65381]: INFO networking_nsxv3.common.synchronization [req-0ef0a52e-0e06-46bb-a6b3-78c6acc086b3 req-4e2ae229-5825-4e42-b1c6-60dbaca60d5e service nova] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_members [ 721.902908] env[65381]: INFO networking_nsxv3.common.synchronization [req-0ef0a52e-0e06-46bb-a6b3-78c6acc086b3 req-4e2ae229-5825-4e42-b1c6-60dbaca60d5e service nova] Enqueued Resource ID: 77522d3c-8cc7-43e4-b860-31d05925d891 with Priority: HIGHEST for action port [ 721.903868] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_rules [ 721.903868] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_members [ 721.903868] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77522d3c-8cc7-43e4-b860-31d05925d891 with Priority: HIGHEST for action port [ 721.904069] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.904260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.904326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.904597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.904730] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.907474] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.907558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.907590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.908295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.908295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.908295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.908295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.908295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.908493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.908493] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.909255] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-77522d3c-8cc7-43e4-b860-31d05925d891 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.909405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.909448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.910669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.910669] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77522d3c-8cc7-43e4-b860-31d05925d891',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.258909] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.259130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.259267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.259560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.259768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.259887] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 722.294364] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.294364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.294626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.294679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.294830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.306121] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 722.411924] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.413658] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.413658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.413658] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77522d3c-8cc7-43e4-b860-31d05925d891 with status ACTIVE [ 722.413658] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.414229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.414229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.414229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.414229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.414229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.414650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.414650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.414650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.414650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.414861] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.414915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.414972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.416030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.416030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.416030] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77522d3c-8cc7-43e4-b860-31d05925d891 is going to be updated. [ 722.464933] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.464933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.464933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.465263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.465405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.466031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77522d3c-8cc7-43e4-b860-31d05925d891" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.919383] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.422306] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.422534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.422625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.422954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.423118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.423253] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 is going to be created. [ 723.450722] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.450722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.450722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.450722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.450925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.463029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 in Status: UNINITIALIZED for 2s [ 724.319635] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.322022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.322022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.322022] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.827931] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.827931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.827931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.827931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.829413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.830167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.830425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.830783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.831075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.833399] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.833399] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.833399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.833399] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.337918] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48eacb50-df32-446c-947a-a00fbf576caa: rpc.has_security_group_logging(os_id): False [ 725.360893] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.360893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.360893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.360893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.360893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.362057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.362057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.362057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.362057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.362057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.362057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.362057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.362057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.362382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.362382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.362558] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.362645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.362683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.363059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.363059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.363059] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 725.434488] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.434698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.434842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.435030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.435235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.451936] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 725.476619] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 in Status: SUCCESS [ 725.476619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.476619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.476619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.476619] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.477148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.477148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.477148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.477148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.477148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.477307] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.980503] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.423501] env[65381]: INFO networking_nsxv3.common.synchronization [req-a06a5ef8-244c-446c-a1f1-cd629b02641d req-b27c74a9-4cf0-4c28-b7f0-2ed5b9f892f7 tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 726.423501] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 726.423501] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.424325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.424637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.425073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.427025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.427025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.427025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.427025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.427025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.427025] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.487653] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6413c0f9-b937-44ab-ae61-b7613757b3e9: rpc.has_security_group_logging(os_id): False [ 726.514020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.514020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.514020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.514020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.514020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.514020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.514020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.514020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.515036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.515165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.515449] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 is going to be created. [ 726.595604] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.595604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.595604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.595791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.595927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.607860] env[65381]: INFO networking_nsxv3.common.synchronization [req-f233bfce-f1a9-48bc-a0fe-9a771984af01 req-182025b0-78a2-4bf2-8dd5-67f7c1a2ebf9 tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 726.608498] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 726.608814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.608936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.614205] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 in Status: IN_PROGRESS for 2s [ 726.930029] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.436662] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.466987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 727.466987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.939486] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.939726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.941340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.941495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.943027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.943027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 727.974373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.974629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.975037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.975037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.975338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.985123] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 728.630628] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 in Status: SUCCESS [ 728.630628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.409432] env[65381]: INFO networking_nsxv3.common.synchronization [req-f610da7a-8a47-446d-a0ff-671c2f06dcfa req-23eda4ef-f47e-416f-aba6-56963d9cff77 tempest-ServersWithSpecificFlavorTestJSON-513012973 tempest-ServersWithSpecificFlavorTestJSON-513012973-project-member] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 729.409432] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 729.412131] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.412311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.412409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.412645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.412828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.412931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.412984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.413181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.413320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.413399] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.918665] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.918665] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.918665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.918665] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be updated. [ 729.946489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.946732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.946732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.946893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.947132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.962025] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: IN_PROGRESS for 2s [ 729.995987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 729.996236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.996452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.996642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.996851] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.997062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.997062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.997273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.997378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.997480] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.154752] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-763 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.154953] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.155088] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.155351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.155604] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.155755] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.155869] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.156100] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.156222] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.156493] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.156544] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.156650] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.156751] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.156860] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.156940] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.157080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.178776] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.178945] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.179266] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.179266] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-763" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.179561] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-b56d6870-e513-4c45-8c69-9146cb456959 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.179743] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.179935] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.180564] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.180564] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b56d6870-e513-4c45-8c69-9146cb456959',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.503689] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.503846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.503968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.504243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.504400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.504928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.504928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.504928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.505267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.506491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.506624] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 730.538897] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.539120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.539171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.539449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.539925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.549886] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 730.683952] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.684554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.684751] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.685139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.685847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.686042] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port b56d6870-e513-4c45-8c69-9146cb456959 not found, creating... [ 730.686406] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.686722] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.686722] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.686875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.687350] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.688140] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.688140] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.688140] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.688412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.688566] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.688736] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: b56d6870-e513-4c45-8c69-9146cb456959 is going to be created. [ 730.722356] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.722646] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.724315] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.724723] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.726044] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.726044] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.487153] env[65381]: INFO networking_nsxv3.common.synchronization [req-f610da7a-8a47-446d-a0ff-671c2f06dcfa req-b051f632-b65d-4698-b171-ca63f8d8d08b service nova] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 731.487153] env[65381]: INFO networking_nsxv3.common.synchronization [req-f610da7a-8a47-446d-a0ff-671c2f06dcfa req-b051f632-b65d-4698-b171-ca63f8d8d08b service nova] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 731.487153] env[65381]: INFO networking_nsxv3.common.synchronization [req-f610da7a-8a47-446d-a0ff-671c2f06dcfa req-b051f632-b65d-4698-b171-ca63f8d8d08b service nova] Enqueued Resource ID: b56d6870-e513-4c45-8c69-9146cb456959 with Priority: HIGHEST for action port [ 731.489291] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_rules [ 731.489449] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 731.489556] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b56d6870-e513-4c45-8c69-9146cb456959 with Priority: HIGHEST for action port [ 731.489944] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.490126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.490299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.490459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.490575] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.493101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.493229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.493569] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b56d6870-e513-4c45-8c69-9146cb456959 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.493722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.493722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.493888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.494012] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b56d6870-e513-4c45-8c69-9146cb456959',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.971414] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 731.971414] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e deletion is rescheduled due to dependency. [ 731.971414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.971669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.971814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.972749] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.972882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.972937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.973763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.973763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.973763] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.995936] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.996217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.998295] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b56d6870-e513-4c45-8c69-9146cb456959 with status ACTIVE [ 731.998295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.999029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.999029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.999029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.999029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.999314] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.999314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.999314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.999409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.999436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.999736] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.999736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.999736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.999898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.002035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.002035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b56d6870-e513-4c45-8c69-9146cb456959 is going to be updated. [ 732.024224] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.024868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.025046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.025752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.025752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.025974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b56d6870-e513-4c45-8c69-9146cb456959" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.476793] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.561996] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 732.562768] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 deletion is rescheduled due to dependency. [ 732.562768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.627510] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 732.628168] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 732.629330] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 732.629330] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 732.629585] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.633019] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.633019] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.633019] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.633019] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.633019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.634103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.634103] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.682403] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_rules [ 732.682403] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 732.682403] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 732.682403] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 732.682403] env[65381]: INFO networking_nsxv3.common.synchronization [req-c839da09-e95a-457c-848a-1c871e305c48 req-05b36877-5cff-4805-b306-2e4d7a0234df tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 6ed4340d-47ce-4ce5-b006-36892b427798 with Priority: HIGHEST for action port [ 732.682403] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_rules [ 732.682629] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 732.682629] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed4340d-47ce-4ce5-b006-36892b427798 with Priority: HIGHEST for action port [ 732.682694] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 732.682772] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 732.683164] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.683257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.683388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.683559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.683625] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.684487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.684596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.685026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.685145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.685303] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.686591] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed4340d-47ce-4ce5-b006-36892b427798 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.687774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.687774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.687774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.687932] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed4340d-47ce-4ce5-b006-36892b427798',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.693038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.693038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.693038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.693038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.979643] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.135748] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.136508] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.191337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.191488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.191752] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ed4340d-47ce-4ce5-b006-36892b427798 with status ACTIVE [ 733.192029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.192165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.192238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.192536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.192645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.193108] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.193108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.193229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.193389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.193494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.193712] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.193873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.193997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.194332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.194412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.194538] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ed4340d-47ce-4ce5-b006-36892b427798 is going to be updated. [ 733.196422] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.196536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.224228] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.224415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.224476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.224641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.224780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.224941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.483437] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.484309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.484309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.486307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.486307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.486307] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be updated. [ 733.519185] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.519185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.519185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.519185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.519185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.528750] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: IN_PROGRESS for 2s [ 733.639116] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.639535] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.140979] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.141865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.141865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.142040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.143727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.143727] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 734.143727] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.143727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.143727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.144356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.144356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.144356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be created. [ 734.174373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.174530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.174586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.174791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.175027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.177671] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.177795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.177851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.178400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.178400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.186292] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: UNINITIALIZED for 2s [ 734.187452] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 734.363112] env[65381]: INFO networking_nsxv3.common.synchronization [req-051216fd-7194-413e-bbf2-d2bb6c36bcfd req-e3a1d235-afda-4ba3-8b29-eb4ffb51eff9 tempest-ServerTagsTestJSON-176018867 tempest-ServerTagsTestJSON-176018867-project-member] Enqueued Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_members [ 734.363709] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 with Priority: HIGHEST for action security_group_members [ 734.364318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.364456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.364518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.364727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.364886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.364986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.365070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.365212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.365298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.365392] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fa502cc-eee4-43e5-bf7a-e5551fb38a40',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.868432] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.868751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.868751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.868885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.868977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.869183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.869281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.869335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.869493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.869577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.869652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 is going to be updated. [ 734.901039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.901039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.901039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.901039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.901039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.911444] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 in Status: IN_PROGRESS for 2s [ 734.913572] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c879010c-c5e2-4a90-b545-1451c9bc0cf9 None None] Enqueued Resource ID: 38fc3d68-7bc6-4e5b-84e8-2386bfd1a029 with Priority: HIGHEST for action port [ 734.913754] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38fc3d68-7bc6-4e5b-84e8-2386bfd1a029 with Priority: HIGHEST for action port [ 734.914229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-38fc3d68-7bc6-4e5b-84e8-2386bfd1a029 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.914401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38fc3d68-7bc6-4e5b-84e8-2386bfd1a029" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.914439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38fc3d68-7bc6-4e5b-84e8-2386bfd1a029" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.914672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38fc3d68-7bc6-4e5b-84e8-2386bfd1a029" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.914966] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38fc3d68-7bc6-4e5b-84e8-2386bfd1a029',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.417474] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38fc3d68-7bc6-4e5b-84e8-2386bfd1a029 [ 735.418446] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.418446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.418446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.418446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.418446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.418446] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38fc3d68-7bc6-4e5b-84e8-2386bfd1a029 already deleted. [ 735.419468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38fc3d68-7bc6-4e5b-84e8-2386bfd1a029" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.543640] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 735.543881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.544059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.544494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.544743] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.544881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.544979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.545214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.545323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.545431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.545569] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.048522] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.203265] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 736.203380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.203499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.203732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.203927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.204063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.204127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.204319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.204403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.204571] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.206586] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 736.206586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.206586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.206586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.206789] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.206858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.207089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.207089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.207201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.207238] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.551925] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40be60f5-b915-4038-8a92-b31ab9bbba3e: rpc.has_security_group_logging(os_id): False [ 736.582761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.582761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.582761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.582761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.582761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.582761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.583396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.583396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.583396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.583396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.583396] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be updated. [ 736.659760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.659939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.660016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.660246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.660394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.678570] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: IN_PROGRESS for 2s [ 736.691060] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e6a734ba-a0dc-4696-be76-c2b114ab95a5 None None] Enqueued Resource ID: 72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7 with Priority: HIGHEST for action port [ 736.691332] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7 with Priority: HIGHEST for action port [ 736.691934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.692236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.692420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.692704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.692804] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.710453] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.718817] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.925115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 in Status: SUCCESS [ 736.925326] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fa502cc-eee4-43e5-bf7a-e5551fb38a40 deletion is rescheduled due to dependency. [ 736.925399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fa502cc-eee4-43e5-bf7a-e5551fb38a40" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.195716] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7 [ 737.197133] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.197133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.197133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.197133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.197133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.197133] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7 already deleted. [ 737.197133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72c4eeb9-0cf9-4faf-a60a-a858aeadd0a7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.220114] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.221749] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.728899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.728899] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be updated. [ 737.728899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.728899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.728899] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 737.769424] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e4d6b51d-9180-4406-aeb0-d93c8617dad6 None None] Enqueued Resource ID: ba2aa8c2-d6e1-44bd-9a82-ad2d36211325 with Priority: HIGHEST for action port [ 737.770032] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba2aa8c2-d6e1-44bd-9a82-ad2d36211325 with Priority: HIGHEST for action port [ 737.770745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba2aa8c2-d6e1-44bd-9a82-ad2d36211325 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.770745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba2aa8c2-d6e1-44bd-9a82-ad2d36211325" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.770745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba2aa8c2-d6e1-44bd-9a82-ad2d36211325" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.770745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba2aa8c2-d6e1-44bd-9a82-ad2d36211325" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.770933] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba2aa8c2-d6e1-44bd-9a82-ad2d36211325',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.775985] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.776253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.776253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.776464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.776635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.779483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.779832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.779927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.780180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.780306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.795218] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: IN_PROGRESS for 2s [ 737.795878] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 738.272864] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba2aa8c2-d6e1-44bd-9a82-ad2d36211325 [ 738.273292] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.273292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.273455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.273838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.273838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.273838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba2aa8c2-d6e1-44bd-9a82-ad2d36211325 already deleted. [ 738.273838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba2aa8c2-d6e1-44bd-9a82-ad2d36211325" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.415379] env[65381]: INFO networking_nsxv3.common.synchronization [None req-cd8ba161-3333-4a50-a3e4-a19fdcbcbacf None None] Enqueued Resource ID: 13c2cc08-cdf4-43df-b595-a4ec73d7cc29 with Priority: HIGHEST for action port [ 738.415379] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c2cc08-cdf4-43df-b595-a4ec73d7cc29 with Priority: HIGHEST for action port [ 738.415379] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-13c2cc08-cdf4-43df-b595-a4ec73d7cc29 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.415379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13c2cc08-cdf4-43df-b595-a4ec73d7cc29" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.415379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13c2cc08-cdf4-43df-b595-a4ec73d7cc29" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.415819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13c2cc08-cdf4-43df-b595-a4ec73d7cc29" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.415819] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13c2cc08-cdf4-43df-b595-a4ec73d7cc29',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.695163] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 738.696132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.920240] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13c2cc08-cdf4-43df-b595-a4ec73d7cc29 [ 738.920477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.920608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.920674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.920886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.920970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.921072] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13c2cc08-cdf4-43df-b595-a4ec73d7cc29 already deleted. [ 738.921151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13c2cc08-cdf4-43df-b595-a4ec73d7cc29" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.512036] env[65381]: INFO networking_nsxv3.common.synchronization [None req-4794841c-8ee9-42d0-880e-81c896e71a62 None None] Enqueued Resource ID: e82478fd-7a93-4465-b80f-e515c88f5e5e with Priority: HIGHEST for action port [ 739.512036] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e82478fd-7a93-4465-b80f-e515c88f5e5e with Priority: HIGHEST for action port [ 739.512525] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e82478fd-7a93-4465-b80f-e515c88f5e5e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.512611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e82478fd-7a93-4465-b80f-e515c88f5e5e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.512743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e82478fd-7a93-4465-b80f-e515c88f5e5e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.512950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e82478fd-7a93-4465-b80f-e515c88f5e5e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.513071] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82478fd-7a93-4465-b80f-e515c88f5e5e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.812174] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 739.812429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.812635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.812912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.813129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.813321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.813513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.813795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.813935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.814063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.814160] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.816106] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 739.816310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.816554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.816730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.816924] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.817158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.817220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.817492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.817596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.818741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.818810] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.016974] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e82478fd-7a93-4465-b80f-e515c88f5e5e [ 740.018514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.018514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.018514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.018514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.018514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.018514] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e82478fd-7a93-4465-b80f-e515c88f5e5e already deleted. [ 740.018514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e82478fd-7a93-4465-b80f-e515c88f5e5e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.153043] env[65381]: INFO networking_nsxv3.common.synchronization [req-c9b29938-8da1-4649-b6f2-5bd61f3b3d0e req-811c41ff-edb1-43d0-9f9c-48b89e299d25 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 740.153630] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 740.153972] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.154296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.154422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.154732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.154938] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.155651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.155651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.155651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.155651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.155651] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.321536] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.321847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.323273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.324080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.324080] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.324080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.324080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.324080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.324288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.324288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.324355] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.324459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.324513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.326001] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.326001] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.326001] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.326001] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.326001] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.326001] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.326001] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.326001] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.326807] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.571410] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.571721] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.571721] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.572126] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.572542] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.572938] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.572938] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.573628] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.573628] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.573628] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.574387] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.575022] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.575190] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.575316] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.575426] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.575559] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.598590] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.598590] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.598590] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.598590] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.601305] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-e503a095-58e5-47a2-b34d-d1e0c384a70a taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.601305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.601305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.601305] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.601532] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e503a095-58e5-47a2-b34d-d1e0c384a70a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.657970] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.658836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.658836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.658836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.658836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.658836] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.658836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.659105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.659105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.659105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.659214] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab already deleted. [ 740.659249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.831553] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48eacb50-df32-446c-947a-a00fbf576caa: rpc.has_security_group_logging(os_id): False [ 740.831553] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 413b19eb-94ec-489a-b47a-feaf8a84da43: rpc.has_security_group_logging(os_id): False [ 740.850664] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.850897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.850897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.851353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.851353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.851600] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.851702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.851765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.851976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.852069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.852262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.852366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.852416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.852558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.852623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.852802] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.852897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.852952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.853283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.853393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.853507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 740.855342] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.855521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.855689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.855808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.855919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.856179] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.856281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.856367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.856648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.856775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.856891] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be created. [ 741.021374] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.021735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.021816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.022122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.023703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.057037] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.057037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.057037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.057037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.057037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.058162] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: IN_PROGRESS for 2s [ 741.074199] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 741.103926] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.104135] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.104244] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.104513] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.108065] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port e503a095-58e5-47a2-b34d-d1e0c384a70a not found, creating... [ 741.108065] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.108065] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.108065] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.108563] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.108563] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.108563] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: e503a095-58e5-47a2-b34d-d1e0c384a70a is going to be created. [ 741.129400] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.129653] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.129739] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.130068] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.130339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.130573] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.817549] env[65381]: INFO networking_nsxv3.common.synchronization [None req-878a3ac7-cc91-43cc-82bd-b2e784f810db tempest-ServersTestJSON-345764332 tempest-ServersTestJSON-345764332-project-member] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_rules [ 741.818183] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_rules [ 741.819128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.819334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.819686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.820010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.821505] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.907754] env[65381]: INFO networking_nsxv3.common.synchronization [None req-0c60e4ab-4b2e-49e7-bf0a-7b4ea2ac20e6 None None] Enqueued Resource ID: a47e29f0-4277-42b4-944b-1adc36c9235b with Priority: HIGHEST for action port [ 741.908555] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e29f0-4277-42b4-944b-1adc36c9235b with Priority: HIGHEST for action port [ 741.908982] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a47e29f0-4277-42b4-944b-1adc36c9235b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.909266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a47e29f0-4277-42b4-944b-1adc36c9235b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.909457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a47e29f0-4277-42b4-944b-1adc36c9235b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.909793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a47e29f0-4277-42b4-944b-1adc36c9235b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.909976] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a47e29f0-4277-42b4-944b-1adc36c9235b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.940949] env[65381]: INFO networking_nsxv3.common.synchronization [req-c9b29938-8da1-4649-b6f2-5bd61f3b3d0e req-8187c9d8-f94e-4d77-8383-50ef814fadf6 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 741.941849] env[65381]: INFO networking_nsxv3.common.synchronization [req-c9b29938-8da1-4649-b6f2-5bd61f3b3d0e req-8187c9d8-f94e-4d77-8383-50ef814fadf6 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 741.942340] env[65381]: INFO networking_nsxv3.common.synchronization [req-c9b29938-8da1-4649-b6f2-5bd61f3b3d0e req-8187c9d8-f94e-4d77-8383-50ef814fadf6 service nova] Enqueued Resource ID: e503a095-58e5-47a2-b34d-d1e0c384a70a with Priority: HIGHEST for action port [ 741.944136] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 741.944136] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 741.944136] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e503a095-58e5-47a2-b34d-d1e0c384a70a with Priority: HIGHEST for action port [ 741.944136] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.947045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.947180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.947460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.947694] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.948652] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.948652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.948652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.948827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.948999] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.949206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.949279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.949429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.949506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.949598] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.952439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e503a095-58e5-47a2-b34d-d1e0c384a70a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.952670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.952670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.952963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.952963] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e503a095-58e5-47a2-b34d-d1e0c384a70a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.137617] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6e0e57a1-c067-4509-a2a7-6f90ffe6f546 tempest-ServersTestJSON-345764332 tempest-ServersTestJSON-345764332-project-member] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_rules [ 742.137617] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_rules [ 742.138104] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.138582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.220857] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a65a9ef3-6606-4a01-8b15-530f74495bc6 None None] Enqueued Resource ID: 0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6 with Priority: HIGHEST for action port [ 742.220857] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6 with Priority: HIGHEST for action port [ 742.221281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.223073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.223073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.223208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.223256] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.297509] env[65381]: INFO networking_nsxv3.common.synchronization [None req-9fbba64c-7a19-4a42-9c6c-50b2b42b53cb None None] Enqueued Resource ID: 872b72be-2b21-441c-bb14-68b392453501 with Priority: HIGHEST for action port [ 742.297783] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872b72be-2b21-441c-bb14-68b392453501 with Priority: HIGHEST for action port [ 742.298419] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-872b72be-2b21-441c-bb14-68b392453501 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.298585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-872b72be-2b21-441c-bb14-68b392453501" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.298662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-872b72be-2b21-441c-bb14-68b392453501" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.300341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-872b72be-2b21-441c-bb14-68b392453501" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.300341] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('872b72be-2b21-441c-bb14-68b392453501',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.343384] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.343578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.343578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.343786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.343874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.343969] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d already deleted. [ 742.344065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.344222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.344371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.344450] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.412155] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a47e29f0-4277-42b4-944b-1adc36c9235b [ 742.412278] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.412404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.412478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.412731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.412833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.413509] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a47e29f0-4277-42b4-944b-1adc36c9235b already deleted. [ 742.413509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a47e29f0-4277-42b4-944b-1adc36c9235b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.457504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.457504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.457504] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.461029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e503a095-58e5-47a2-b34d-d1e0c384a70a with status ACTIVE [ 742.461029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.461029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.461029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.461029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.461029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e503a095-58e5-47a2-b34d-d1e0c384a70a is going to be updated. [ 742.491738] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.491985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.492082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.492295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.492434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.492596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e503a095-58e5-47a2-b34d-d1e0c384a70a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.725736] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6 [ 742.726048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.726238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.726333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.726522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.726613] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.726707] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6 already deleted. [ 742.726787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aef7535-77e8-4f4e-a14a-b7bbc12c7fa6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.728914] env[65381]: INFO networking_nsxv3.common.synchronization [None req-476002ea-42ba-4407-a68b-6b6572c4a0b4 None None] Enqueued Resource ID: 71b36b3f-e56d-4d89-ab18-94d4b4f40507 with Priority: HIGHEST for action port [ 742.729184] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b36b3f-e56d-4d89-ab18-94d4b4f40507 with Priority: HIGHEST for action port [ 742.730896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b36b3f-e56d-4d89-ab18-94d4b4f40507 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.730896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b36b3f-e56d-4d89-ab18-94d4b4f40507" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.730896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b36b3f-e56d-4d89-ab18-94d4b4f40507" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.730896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b36b3f-e56d-4d89-ab18-94d4b4f40507" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.730896] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b36b3f-e56d-4d89-ab18-94d4b4f40507',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.801569] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 872b72be-2b21-441c-bb14-68b392453501 [ 742.802034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.802034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.802034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.802252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.802381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.802435] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:872b72be-2b21-441c-bb14-68b392453501 already deleted. [ 742.803104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-872b72be-2b21-441c-bb14-68b392453501" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.867115] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.868802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.868802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.868802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.868802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.868802] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d already deleted. [ 742.868802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.963801] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.072033] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 743.072545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.087392] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 743.090148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.236112] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71b36b3f-e56d-4d89-ab18-94d4b4f40507 [ 743.236112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.236112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.236112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.236684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.237057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.237057] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71b36b3f-e56d-4d89-ab18-94d4b4f40507 already deleted. [ 743.237057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b36b3f-e56d-4d89-ab18-94d4b4f40507" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.467613] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.468526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.468526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.468526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.468526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.468526] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be created. [ 743.498170] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.498170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.498170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.498170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.498170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.511758] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: UNINITIALIZED for 2s [ 744.632475] env[65381]: INFO networking_nsxv3.common.synchronization [req-4a6c396b-d826-42ea-abd8-0d7f51e92b91 req-239123d0-0468-4f3e-93e2-72bdec823eea tempest-ServerAddressesTestJSON-900036973 tempest-ServerAddressesTestJSON-900036973-project-member] Enqueued Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_members [ 744.632752] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_members [ 744.632859] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.633032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.633836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.634201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.635949] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.635949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.635949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.635949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.635949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.635949] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.036642] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1e2af42c-a47c-470e-8371-19207374d9a6 None None] Enqueued Resource ID: 05cc294e-27bb-439c-98dc-d77949de1da3 with Priority: HIGHEST for action port [ 745.037142] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05cc294e-27bb-439c-98dc-d77949de1da3 with Priority: HIGHEST for action port [ 745.037449] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-05cc294e-27bb-439c-98dc-d77949de1da3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.038374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05cc294e-27bb-439c-98dc-d77949de1da3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.038442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05cc294e-27bb-439c-98dc-d77949de1da3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.038683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05cc294e-27bb-439c-98dc-d77949de1da3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.038771] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cc294e-27bb-439c-98dc-d77949de1da3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.141188] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.141188] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.141188] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 already deleted. [ 745.141188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.416676] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-178 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.417022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-178" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.417022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-178" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.417388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-178" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.417661] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.417847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.417963] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.418254] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.418419] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.418630] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.418742] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.418861] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.418972] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.419095] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.419209] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.419335] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.439666] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.439857] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.439995] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.440199] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-178" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.440564] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-fa9db688-a904-47dc-b6fd-60f2f3db3993 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.440697] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.440801] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.441135] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.441289] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9db688-a904-47dc-b6fd-60f2f3db3993',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.524342] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 745.524929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.527017] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.527017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.527017] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.541849] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05cc294e-27bb-439c-98dc-d77949de1da3 [ 745.541849] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.542061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.542099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.542308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.542395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.542487] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05cc294e-27bb-439c-98dc-d77949de1da3 already deleted. [ 745.542570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05cc294e-27bb-439c-98dc-d77949de1da3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.944258] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.944629] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.944813] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.945156] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.945412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.945541] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port fa9db688-a904-47dc-b6fd-60f2f3db3993 not found, creating... [ 745.945821] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.945981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.946120] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.946412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.946622] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.947017] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.947397] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.947677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.948014] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.948297] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.948485] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: fa9db688-a904-47dc-b6fd-60f2f3db3993 is going to be created. [ 745.970338] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.970525] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.970525] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.970800] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.971039] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.971263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.030616] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.030813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.030881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.031056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.031232] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.031334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.031398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.031554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.031640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.031728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.031874] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.032093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.032193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.032277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.032413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.032501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.032563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.032942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.033111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.033205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.033295] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.043823] env[65381]: INFO networking_nsxv3.common.synchronization [None req-23d0112c-bdb6-4fff-8b4d-9c54ba5e56c1 None None] Enqueued Resource ID: 05d272c3-2407-44c9-a32f-50da5bd92c77 with Priority: HIGHEST for action port [ 746.044089] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d272c3-2407-44c9-a32f-50da5bd92c77 with Priority: HIGHEST for action port [ 746.045318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d272c3-2407-44c9-a32f-50da5bd92c77 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.045450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d272c3-2407-44c9-a32f-50da5bd92c77" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.046014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d272c3-2407-44c9-a32f-50da5bd92c77" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.046341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d272c3-2407-44c9-a32f-50da5bd92c77" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.046431] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d272c3-2407-44c9-a32f-50da5bd92c77',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.539660] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a23f96-505a-4b63-87f3-5175bacc51ab: rpc.has_security_group_logging(os_id): False [ 746.551850] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05d272c3-2407-44c9-a32f-50da5bd92c77 [ 746.552438] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.553060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.553060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.553300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.553389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.553494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05d272c3-2407-44c9-a32f-50da5bd92c77 already deleted. [ 746.553581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d272c3-2407-44c9-a32f-50da5bd92c77" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.557988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.557988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.557988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.558550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.558550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.558776] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.558880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.558937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.559127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.559512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.559512] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.559512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.559512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.559772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.559772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.559906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.559986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.560488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.560488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.560488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.560488] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be created. [ 746.634296] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.634760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.634760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.634760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.634949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.648401] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 746.684049] env[65381]: INFO networking_nsxv3.common.synchronization [req-4a6c396b-d826-42ea-abd8-0d7f51e92b91 req-89bbe1a4-cdbb-4e2a-a6b7-4becf8dd2d80 service nova] Enqueued Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_rules [ 746.684846] env[65381]: INFO networking_nsxv3.common.synchronization [req-4a6c396b-d826-42ea-abd8-0d7f51e92b91 req-89bbe1a4-cdbb-4e2a-a6b7-4becf8dd2d80 service nova] Enqueued Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_members [ 746.684846] env[65381]: INFO networking_nsxv3.common.synchronization [req-4a6c396b-d826-42ea-abd8-0d7f51e92b91 req-89bbe1a4-cdbb-4e2a-a6b7-4becf8dd2d80 service nova] Enqueued Resource ID: fa9db688-a904-47dc-b6fd-60f2f3db3993 with Priority: HIGHEST for action port [ 746.684846] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_rules [ 746.684846] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_members [ 746.684846] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9db688-a904-47dc-b6fd-60f2f3db3993 with Priority: HIGHEST for action port [ 746.685346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.685484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.685521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.685773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.685849] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.688248] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.688402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.688722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.688722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.688879] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.688999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.689096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.690060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.690060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.690060] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.690370] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa9db688-a904-47dc-b6fd-60f2f3db3993 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.690498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.690565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.690702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.690785] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9db688-a904-47dc-b6fd-60f2f3db3993',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.193743] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.194063] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.194140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.194355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa9db688-a904-47dc-b6fd-60f2f3db3993 with status ACTIVE [ 747.194477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.194581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.194636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.194959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.194959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.195908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.195908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.195908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.195908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.195908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.201016] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.201016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.201016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.201016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.201016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.201016] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa9db688-a904-47dc-b6fd-60f2f3db3993 is going to be updated. [ 747.223211] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.223211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.223211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.223211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.223211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.223211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa9db688-a904-47dc-b6fd-60f2f3db3993" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.577454] env[65381]: INFO networking_nsxv3.common.synchronization [None req-2dcfa04e-c81b-47bb-bef0-8e1bdf04e12e tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 747.579713] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 747.583878] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.583878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.583878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.583878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.583878] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.703815] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.741599] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1965bcd1-06f4-4ff2-bd87-48b35f91c46a tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 747.742159] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 747.742466] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.742596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.106852] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.106852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.106852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.107211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.107211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.107347] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d already deleted. [ 748.107457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.107687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.107853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.107933] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.206602] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.206990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.206990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.207167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.207167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.207244] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 is going to be created. [ 748.230578] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.230726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.230798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.231012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.231183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.241763] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 in Status: UNINITIALIZED for 2s [ 748.593966] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5a3cad7-6b29-40b0-aedb-77565f102241 req-987c1beb-b189-40e0-a663-0695f32bbd35 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 748.594541] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 748.596223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.596223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.596223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.596223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.596223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.596485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.596485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.596551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.596618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.596710] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.630148] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.630304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.630382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.630628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.630717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.631355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d already deleted. [ 748.631355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.660753] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 748.660753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.849533] env[65381]: INFO networking_nsxv3.common.synchronization [None req-56dc0b41-0751-4850-b8a9-07f8ed4e425f None None] Enqueued Resource ID: c543ad05-9817-4c41-a9b7-1626d38619a2 with Priority: HIGHEST for action port [ 748.849533] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c543ad05-9817-4c41-a9b7-1626d38619a2 with Priority: HIGHEST for action port [ 748.849695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c543ad05-9817-4c41-a9b7-1626d38619a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.849817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c543ad05-9817-4c41-a9b7-1626d38619a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.849921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c543ad05-9817-4c41-a9b7-1626d38619a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.850205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c543ad05-9817-4c41-a9b7-1626d38619a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.850282] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c543ad05-9817-4c41-a9b7-1626d38619a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.065838] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.065838] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.065838] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.066114] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.066297] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.066475] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.066603] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.066848] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.067022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.067676] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.067872] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.068065] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.068277] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.068517] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.068701] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.068900] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.090823] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.090994] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.091145] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.091308] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.091617] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-23b58a94-8b00-4d30-963d-f02a95bc45c6 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.092267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.092267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.092573] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.092573] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b58a94-8b00-4d30-963d-f02a95bc45c6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.099934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.099934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.099934] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 already deleted. [ 749.099934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.353433] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c543ad05-9817-4c41-a9b7-1626d38619a2 [ 749.353850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.353850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.353850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.354354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.354354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.354354] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c543ad05-9817-4c41-a9b7-1626d38619a2 already deleted. [ 749.354354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c543ad05-9817-4c41-a9b7-1626d38619a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.598047] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.598047] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 23b58a94-8b00-4d30-963d-f02a95bc45c6 not found, creating... [ 749.598047] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.598047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.599438] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.599923] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.602920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.602920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.602920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.602920] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 23b58a94-8b00-4d30-963d-f02a95bc45c6 is going to be created. [ 749.627336] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.627615] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.627748] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.628069] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.628367] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.628684] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.259047] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 in Status: SUCCESS [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.259047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.259047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.263660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.263821] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.361683] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5a3cad7-6b29-40b0-aedb-77565f102241 req-9e7e3509-003e-4379-a882-767d5f277bd5 service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 750.361941] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5a3cad7-6b29-40b0-aedb-77565f102241 req-9e7e3509-003e-4379-a882-767d5f277bd5 service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 750.362143] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5a3cad7-6b29-40b0-aedb-77565f102241 req-9e7e3509-003e-4379-a882-767d5f277bd5 service nova] Enqueued Resource ID: 23b58a94-8b00-4d30-963d-f02a95bc45c6 with Priority: HIGHEST for action port [ 750.362663] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 750.362802] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 750.362937] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b58a94-8b00-4d30-963d-f02a95bc45c6 with Priority: HIGHEST for action port [ 750.365448] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.365448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.365448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.366409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.366508] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.367675] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.367894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.368798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.369023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.369194] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.369307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.369367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.369527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.369612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.369707] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.370540] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b58a94-8b00-4d30-963d-f02a95bc45c6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.370648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.370732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.370878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.370956] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b58a94-8b00-4d30-963d-f02a95bc45c6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.767364] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.767364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.767364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.767570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.768411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.768411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.768411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.768411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.768411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.768411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.768411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.768725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.768725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.768725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.768815] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.768857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.768953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.769073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.769156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.769442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.769442] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.873636] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.873757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.873972] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.874945] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b58a94-8b00-4d30-963d-f02a95bc45c6 with status ACTIVE [ 750.875134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.875249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.875312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.875782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.877861] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.877861] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.877861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.880379] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b58a94-8b00-4d30-963d-f02a95bc45c6 is going to be updated. [ 750.909079] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.909297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.909297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.909515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.909724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.909817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b58a94-8b00-4d30-963d-f02a95bc45c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.273271] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e2dd58b-5e4b-4dc2-b012-9446a5a94987: rpc.has_security_group_logging(os_id): False [ 751.292514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.292514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.292514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.292719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.292749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.292931] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.293130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.293130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.293374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.293374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.293956] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.293956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.293956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.293956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.293956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.294517] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.294517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.294517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.294517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.294517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.294517] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 is going to be created. [ 751.363746] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.364113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.364113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.364427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.364521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.378017] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 in Status: IN_PROGRESS for 2s [ 751.382729] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.825035] env[65381]: INFO networking_nsxv3.common.synchronization [req-59c87760-d19b-4386-a033-be4827305a58 req-03640f8a-e6da-454e-b8d3-bace69e19c4c tempest-MigrationsAdminTest-1004936190 tempest-MigrationsAdminTest-1004936190-project-member] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 751.825671] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 751.825974] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.826908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.826982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.827190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.827359] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.827457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.827516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.827657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.827738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.827826] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.887647] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.887647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.887647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.887647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.887647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.887647] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be created. [ 751.910960] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.911134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.911338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.911408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.911589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.922694] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: UNINITIALIZED for 2s [ 752.333238] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.397704] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.398049] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.398140] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.398430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.398687] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.398929] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.398994] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.399543] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.399543] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.399657] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.399813] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.399977] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.400125] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.400265] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.400403] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.400562] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.422589] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.422800] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.422950] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.423170] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.423586] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-73c0e968-3a31-4e1b-b384-f52b453b336d taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.423715] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.423847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.424180] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.424318] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c0e968-3a31-4e1b-b384-f52b453b336d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.836415] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.926751] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.927049] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.927133] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.927400] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.927540] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.927688] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 73c0e968-3a31-4e1b-b384-f52b453b336d not found, creating... [ 752.927949] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.928121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.928233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.928445] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.928572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.928876] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.929044] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.929108] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.929310] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.929440] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.929584] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 73c0e968-3a31-4e1b-b384-f52b453b336d is going to be created. [ 752.951964] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.952237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.952365] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.952649] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.952995] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.953267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.339617] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.339775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.339775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.340074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.340209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.340330] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be updated. [ 753.370707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.370912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.370912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.371153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.371317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.382483] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: IN_PROGRESS for 2s [ 753.390363] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 in Status: SUCCESS [ 753.390363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.745178] env[65381]: INFO networking_nsxv3.common.synchronization [req-59c87760-d19b-4386-a033-be4827305a58 req-8f3136f4-cc5e-4659-a96d-b0418c184bec service nova] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_rules [ 753.745178] env[65381]: INFO networking_nsxv3.common.synchronization [req-59c87760-d19b-4386-a033-be4827305a58 req-8f3136f4-cc5e-4659-a96d-b0418c184bec service nova] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 753.745178] env[65381]: INFO networking_nsxv3.common.synchronization [req-59c87760-d19b-4386-a033-be4827305a58 req-8f3136f4-cc5e-4659-a96d-b0418c184bec service nova] Enqueued Resource ID: 73c0e968-3a31-4e1b-b384-f52b453b336d with Priority: HIGHEST for action port [ 753.745688] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_rules [ 753.745688] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 753.745688] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c0e968-3a31-4e1b-b384-f52b453b336d with Priority: HIGHEST for action port [ 753.746323] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.746391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.746506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.746772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.746772] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.748713] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.748713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.748713] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c0e968-3a31-4e1b-b384-f52b453b336d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.748713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.748713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.748713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.748713] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c0e968-3a31-4e1b-b384-f52b453b336d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.933331] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 753.933331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.933502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.933749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.934125] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.934300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.934381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.935253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.935253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.935253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.935253] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.955778] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc31c393-5d5b-4234-83b9-387b8ecb9a63 req-8327fa74-bf10-4844-aa5b-9e8f70820c32 tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 753.956330] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 753.956631] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.956816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.956888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.957406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.957406] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.957520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.957555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.957689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.957784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.957859] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.250299] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.250649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.250745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73c0e968-3a31-4e1b-b384-f52b453b336d with status ACTIVE [ 754.250843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.250952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.251028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.251242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.251328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.251493] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.251625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.251666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.251841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.251880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.252294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.252294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.252294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.252508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.252508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.252610] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73c0e968-3a31-4e1b-b384-f52b453b336d is going to be updated. [ 754.276779] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.276943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.277038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.277368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.277796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.277796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c0e968-3a31-4e1b-b384-f52b453b336d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.311911] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.312318] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.312408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.312645] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.312899] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.313159] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.313282] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.313492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.313626] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.313832] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.314366] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.314496] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.314608] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.314722] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.314828] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.314959] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.354935] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.355122] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.355320] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.355513] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.355883] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-8aecc39c-3f83-432a-93df-be2e54885a45 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.356083] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.356202] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.356517] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.356685] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aecc39c-3f83-432a-93df-be2e54885a45',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.440020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.440020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.440020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.440020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.440020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.440705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.440705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.440705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.440705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.440997] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.461103] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.461330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.461330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.462268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.462268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.462268] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.462268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.462268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.462268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.462268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.462268] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb already deleted. [ 754.462621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.859130] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.859859] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.859859] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.859859] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.860069] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.860459] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 8aecc39c-3f83-432a-93df-be2e54885a45 not found, creating... [ 754.860459] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.860601] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.860722] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.861172] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.861172] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.861383] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.861453] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.861551] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.862034] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.862034] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.862034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 8aecc39c-3f83-432a-93df-be2e54885a45 is going to be created. [ 754.884269] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.884523] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.884723] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.884905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.885177] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.885391] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.944529] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f08ea40-f56b-4bd5-a0f9-e991cad65528: rpc.has_security_group_logging(os_id): False [ 754.967489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.967644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.967715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.967934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.968051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.968245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.968348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.968412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.968562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.968642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.968845] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.968963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.969032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.969248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.969327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.969506] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.969618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.969711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.969896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.969973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.970074] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be created. [ 755.038787] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.038994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.038994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.039213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.039432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.050644] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 755.392216] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 755.392439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.392614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.392826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.393018] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.393142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.393207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.393363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.393446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.393542] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.562854] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc31c393-5d5b-4234-83b9-387b8ecb9a63 req-02b13aab-8b8b-4019-8e89-9fc4d9c1217e service nova] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_rules [ 755.563177] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc31c393-5d5b-4234-83b9-387b8ecb9a63 req-02b13aab-8b8b-4019-8e89-9fc4d9c1217e service nova] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 755.563361] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc31c393-5d5b-4234-83b9-387b8ecb9a63 req-02b13aab-8b8b-4019-8e89-9fc4d9c1217e service nova] Enqueued Resource ID: 8aecc39c-3f83-432a-93df-be2e54885a45 with Priority: HIGHEST for action port [ 755.563921] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_rules [ 755.564128] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 755.564281] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8aecc39c-3f83-432a-93df-be2e54885a45 with Priority: HIGHEST for action port [ 755.564823] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.565011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.565112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.565422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.565538] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.567502] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.567594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.567594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.569250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.569250] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.569250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.569250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.569250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.569250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.569250] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.569250] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8aecc39c-3f83-432a-93df-be2e54885a45 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.569866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.569866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.569866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.569866] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8aecc39c-3f83-432a-93df-be2e54885a45',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.619081] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 755.619244] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_members [ 755.619380] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 755.619859] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 755.620017] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_members [ 755.621833] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 755.621833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.621833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.621833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.621833] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.625247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b43997e-750b-4b84-8753-4d1519f37ae2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.626063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.626063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.626063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.626063] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.626063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.626411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.626444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.626607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.626784] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.628047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.628275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.628376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.628558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.628821] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.629172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.629306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.629543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.629599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.629699] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.681291] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_rules [ 755.681461] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_members [ 755.681614] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_rules [ 755.681714] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 755.681833] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 755.681952] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 755.682504] env[65381]: INFO networking_nsxv3.common.synchronization [req-d74ee013-c77d-4382-b2c0-7eb852ba4cab req-9a6cf267-fa17-45d6-975c-cccfc0c68831 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 6ed4340d-47ce-4ce5-b006-36892b427798 with Priority: HIGHEST for action port [ 755.682600] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_rules [ 755.682731] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_rules [ 755.682831] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 755.682929] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ed4340d-47ce-4ce5-b006-36892b427798 with Priority: HIGHEST for action port [ 755.683550] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_rules [ 755.683708] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_members [ 755.683811] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 755.684125] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b43997e-750b-4b84-8753-4d1519f37ae2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.684261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.684315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.684597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.684697] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.685685] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.685685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.685878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.685878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.685974] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.687453] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.687453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.687453] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ed4340d-47ce-4ce5-b006-36892b427798 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.687453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.687821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.687821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.687821] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ed4340d-47ce-4ce5-b006-36892b427798',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.688464] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.688575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.688629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.688786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.688861] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.689324] env[65381]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 755.690037] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b43997e-750b-4b84-8753-4d1519f37ae2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.690133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.690497] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.690597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.896107] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.071887] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.073324] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.073445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.073598] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8aecc39c-3f83-432a-93df-be2e54885a45 with status ACTIVE [ 756.073748] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.073880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.073959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.074136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.074228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.074400] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.074497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.074557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.074708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.074777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.074952] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.077961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.077961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.077961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.077961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.077961] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8aecc39c-3f83-432a-93df-be2e54885a45 is going to be updated. [ 756.101909] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.102195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.102239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.102466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.102605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.102772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8aecc39c-3f83-432a-93df-be2e54885a45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.132482] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.134058] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.140282] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.192344] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b43997e-750b-4b84-8753-4d1519f37ae2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.192526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.192798] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.193073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.193135] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ed4340d-47ce-4ce5-b006-36892b427798 with status ACTIVE [ 756.193284] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.193418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.193501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.193738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.193844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.194081] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.194204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.194268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.194471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.194567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.194783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.195398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.195452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.195589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.195811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.195934] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ed4340d-47ce-4ce5-b006-36892b427798 is going to be updated. [ 756.205435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.205435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.221554] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.221719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.221719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.221861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.222020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.222331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ed4340d-47ce-4ce5-b006-36892b427798" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.399344] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.521128] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-e3d306d7-c5c7-4f0c-8f13-7f0977c9ccd6 tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 756.521769] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 756.524701] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.524701] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.524701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.524701] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.580369] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.640758] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.642875] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.644057] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.901880] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.902566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.902566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.902566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.902566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.903089] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be updated. [ 756.935962] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.936304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.936395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.936665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.936878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.950650] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: IN_PROGRESS for 2s [ 757.028047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.028251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.028300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.028574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.028667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.028863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.028967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.029060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.029228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.029568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.029568] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 already deleted. [ 757.029568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.066811] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 757.067147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.078982] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-4a50b562-c2c2-4359-994f-3171a415090c tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 757.079883] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 757.080427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.080659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.080806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.081151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.081447] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.081646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.081912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.082116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.082283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.082478] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.085268] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.085468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.085677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.085974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.086054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.086228] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be created. [ 757.117482] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.117644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.117707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.117993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.118277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.129200] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: UNINITIALIZED for 2s [ 757.144871] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.145072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.145177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.145403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.145554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.145704] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 is going to be created. [ 757.147459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.148049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.148049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.148049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.148455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.148455] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 757.150244] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.150378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.151036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.151036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.151036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.151036] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be updated. [ 757.188630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.188816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.188857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.189102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.189292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.194906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.194981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.195061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.195378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.195543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.198166] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.198166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.198166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.198166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.198166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.221115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: UNINITIALIZED for 2s [ 757.221826] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: IN_PROGRESS for 2s [ 757.222494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 757.480636] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-ff3d296d-a322-4cbf-83de-e2bed26890f3 tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 757.481523] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 757.481890] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.482069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.585307] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.585511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.585607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.585860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.585980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.586346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.586458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.586497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.586685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.586790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.586896] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 already deleted. [ 757.586996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.587204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.587381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.587640] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.587746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.587807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.587953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.588050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.588131] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.899503] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.900602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.900602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.900602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.900602] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.900774] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.900774] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.901040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.901231] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.901444] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.901551] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.901657] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.901750] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.901851] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.901949] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.902274] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.965558] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.965558] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.063 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.965774] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.965877] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.966548] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.966548] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.966818] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.966932] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.967088] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be1fdc9-1f82-4622-ac77-ccee42bf0f35',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.092540] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.092737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.092787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.092987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.093119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.093368] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.093471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.093532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.093691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.093769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.093854] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 already deleted. [ 758.093930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.469793] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.470053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.470655] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.470655] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.470836] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.470909] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 3be1fdc9-1f82-4622-ac77-ccee42bf0f35 not found, creating... [ 758.471213] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.471367] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.472363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.472363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.472363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.472363] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.472705] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.472750] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.475618] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.475903] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.476196] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 3be1fdc9-1f82-4622-ac77-ccee42bf0f35 is going to be created. [ 758.500311] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.500419] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.500459] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.500773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.501019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.501267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.961410] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 758.961701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.961836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.962157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.962375] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.962567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.962648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.962851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.962951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.963088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.963194] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.125668] env[65381]: INFO networking_nsxv3.common.synchronization [req-3fa321ae-9d29-4ebf-a63a-a6977ab08848 req-feda630f-c786-4c5e-84d3-49b47a84bf33 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 759.127083] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 759.127598] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.127730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.127796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.128016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.128172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.128276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.128341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.128496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.128580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.128676] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.140761] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 759.140761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.140761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.140761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.141046] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.141046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.141046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.141656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.142058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.142058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.142058] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.234793] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 759.235129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.235290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.235530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.235745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.235870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.235938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.236144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.236231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.236326] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.238757] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 759.238939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.240714] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: SUCCESS [ 759.240942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.241060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.241246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.241417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.241528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.241598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.241995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.241995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.241995] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.243520] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-83a83c20-b62f-4c43-994a-bee7f459e481 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 759.243888] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-83a83c20-b62f-4c43-994a-bee7f459e481 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 759.243888] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-83a83c20-b62f-4c43-994a-bee7f459e481 service nova] Enqueued Resource ID: 3be1fdc9-1f82-4622-ac77-ccee42bf0f35 with Priority: HIGHEST for action port [ 759.244087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.245568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.247616] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.247616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.247616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.247616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.247616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.247616] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.248180] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 759.248316] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 759.248414] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be1fdc9-1f82-4622-ac77-ccee42bf0f35 with Priority: HIGHEST for action port [ 759.250911] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.251648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.251648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.251725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.251759] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.253075] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.253240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.253330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.253515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.253708] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.253861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.253936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.254143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.254258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.254394] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.256168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.256302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.256376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.256562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.256631] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be1fdc9-1f82-4622-ac77-ccee42bf0f35',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.469546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.469647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.469717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.469939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.470146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.470251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.470311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.472023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.472023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.472023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.472023] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.630927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.631296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.631420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.631678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.631778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.632116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.632327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.632381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.632629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.632719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.632867] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 759.647989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.650552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.650552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.650793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.650994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.651125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.651209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.651384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.651479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.651552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.651759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.651917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.651985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.652324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.652324] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.652416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.652477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.652617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.652698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.652780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.652874] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.662328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.662494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.662566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.662793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.662950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.674626] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 759.741126] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.742983] env[65381]: INFO networking_nsxv3.common.synchronization [req-186d9604-8cbf-4a48-8f5a-90fa5147ae38 req-eaec6da5-b811-4c24-b0a4-78de4e515480 tempest-ImagesOneServerTestJSON-181662735 tempest-ImagesOneServerTestJSON-181662735-project-member] Enqueued Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_members [ 759.747023] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGHEST for action security_group_members [ 759.747023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.747023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.747023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.747023] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.748579] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.756495] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.758726] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.758726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.760883] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.762352] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3be1fdc9-1f82-4622-ac77-ccee42bf0f35 with status ACTIVE [ 759.762906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.762906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.763336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.764358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.764358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.764358] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.764358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.764358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.764633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.764633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.764633] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.764761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.764796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.764926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.765228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.765267] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3be1fdc9-1f82-4622-ac77-ccee42bf0f35 is going to be updated. [ 759.788911] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.789108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.789167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.789383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.789486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.789660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be1fdc9-1f82-4622-ac77-ccee42bf0f35" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.974046] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb17e366-3b38-46cd-836a-5d640fa33c5a: rpc.has_security_group_logging(os_id): False [ 760.000045] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.000185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.000266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.000510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.000605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.000807] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.000952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.000988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.001150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.001230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.001413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.001504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.001563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.001701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.001767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.001948] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.003983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.004118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.004284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.004384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.004490] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be updated. [ 760.081473] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.081945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.081945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.081945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.082120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.095878] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: IN_PROGRESS for 2s [ 760.098720] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-148 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.098907] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-148" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.099234] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-148" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.099793] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-148" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.100561] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.100561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.100561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.100726] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.100877] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.101153] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.101306] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.101433] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.101548] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.101665] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.101777] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.102606] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.122516] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.122687] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.122823] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.123106] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-148" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.123328] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-25948272-7994-47d2-9b12-b5967c367279 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.123525] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.123644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.124273] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.124273] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25948272-7994-47d2-9b12-b5967c367279',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.157129] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb: rpc.has_security_group_logging(os_id): False [ 760.187043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.187043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.187265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.187404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.187404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.187581] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.187683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.187747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.187888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.188012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.188277] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.188382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.188445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.189144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.189144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.189413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.189413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.189413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.189917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.189917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.189917] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be created. [ 760.245906] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.251410] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.251550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.251624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.251906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.251956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.252194] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.252305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.252369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.252520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.253105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.253105] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 is going to be updated. [ 760.253884] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.257967] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.258120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.258157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.258313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.258494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.259494] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.262419] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.270999] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 760.284569] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.284673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.284673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.285070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.285070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.297515] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 in Status: IN_PROGRESS for 2s [ 760.627103] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.627333] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.627457] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.627736] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.627882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.628041] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 25948272-7994-47d2-9b12-b5967c367279 not found, creating... [ 760.628300] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.628458] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.628572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.628783] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.628912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.629201] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.629354] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.629467] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.629666] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.629824] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.629920] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 25948272-7994-47d2-9b12-b5967c367279 is going to be created. [ 760.655579] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.655743] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.656487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.656487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.656487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.656487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.748285] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.748532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.748655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.748957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.749314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.749314] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 760.756440] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.756649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.756735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.757059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.757151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.757243] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be updated. [ 760.763011] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.763011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.763011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.763011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.763840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.763840] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be created. [ 760.764927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.764927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.764927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.765203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.765203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.765203] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 is going to be updated. [ 760.819910] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.820184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.820248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.820550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.820791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.832502] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.832720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.832806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.833118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.833330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.835806] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.835986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.836106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.836381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.836581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.841179] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: UNINITIALIZED for 2s [ 760.847619] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 760.848518] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: IN_PROGRESS for 2s [ 760.873473] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.873763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.873894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.874245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.874492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.888063] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: IN_PROGRESS for 2s [ 761.391152] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-c4fda1ec-ebe1-44b1-8e14-b444e2ca4a34 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 761.391152] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-c4fda1ec-ebe1-44b1-8e14-b444e2ca4a34 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 761.391152] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-c4fda1ec-ebe1-44b1-8e14-b444e2ca4a34 service nova] Enqueued Resource ID: 25948272-7994-47d2-9b12-b5967c367279 with Priority: HIGHEST for action port [ 761.391152] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 761.391152] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 761.391152] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25948272-7994-47d2-9b12-b5967c367279 with Priority: HIGHEST for action port [ 761.391152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.391152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.392056] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.392346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.392682] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-25948272-7994-47d2-9b12-b5967c367279 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.393150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.393150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.393466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.393658] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25948272-7994-47d2-9b12-b5967c367279',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.685944] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 761.686467] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 761.686608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.898480] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25948272-7994-47d2-9b12-b5967c367279 with status ACTIVE [ 761.899707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.899707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.899707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.899707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.899707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.899707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.899707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.900030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.900030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.900271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.900368] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.900468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.900537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.900673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.900786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.900824] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25948272-7994-47d2-9b12-b5967c367279 is going to be updated. [ 761.928845] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.929093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.929182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.929439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.929585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.929749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25948272-7994-47d2-9b12-b5967c367279" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111527] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 762.111963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.294203] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 762.294453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.296648] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-664 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.296902] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.296963] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.297740] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.298190] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.298190] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.298312] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.298589] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.298776] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.299035] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.299158] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.299271] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.299398] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.299525] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.299631] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.299769] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.312042] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 in Status: SUCCESS [ 762.312299] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 deletion is rescheduled due to dependency. [ 762.312299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.323184] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.323184] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.323184] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.323441] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-664" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.324187] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-9c10ede0-8ff0-40fd-b90a-41b807d208ff taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.324187] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.324187] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.324693] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.324693] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c10ede0-8ff0-40fd-b90a-41b807d208ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.610175] env[65381]: INFO networking_nsxv3.common.synchronization [None req-782ce961-d953-42e1-b16b-52da8ba159ea None None] Enqueued Resource ID: 8390e1cc-f6af-47e5-a596-f9c8a2224303 with Priority: HIGHEST for action port [ 762.610729] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8390e1cc-f6af-47e5-a596-f9c8a2224303 with Priority: HIGHEST for action port [ 762.611098] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8390e1cc-f6af-47e5-a596-f9c8a2224303 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.611226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8390e1cc-f6af-47e5-a596-f9c8a2224303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.611303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8390e1cc-f6af-47e5-a596-f9c8a2224303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.611584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8390e1cc-f6af-47e5-a596-f9c8a2224303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.611672] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8390e1cc-f6af-47e5-a596-f9c8a2224303',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.827508] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.827751] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.827871] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.828189] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.828340] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.828488] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 9c10ede0-8ff0-40fd-b90a-41b807d208ff not found, creating... [ 762.828748] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.828912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.829040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.829262] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.829394] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.829661] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.829811] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.829924] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.830175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.830339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.830479] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 9c10ede0-8ff0-40fd-b90a-41b807d208ff is going to be created. [ 762.852416] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.852648] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.852741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.853015] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.853343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.853571] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.855595] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 762.855792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.855990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.856254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.856504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.856635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.856702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.856865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.856951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.857053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.857155] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.858268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.858437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.858611] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.858751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.858819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.859016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.859632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.859632] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.861772] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 762.862452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.862818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 762.863040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.863268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.863477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.863711] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.863862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.864049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.864461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.864461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.864461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.864645] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.865872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.866125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.866356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.866505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.866612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.866813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.866888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.866967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.867232] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.897421] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: SUCCESS [ 762.897646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.897817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.898058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.898261] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.898379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.898445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.898630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.898824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.898932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.899039] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.114194] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8390e1cc-f6af-47e5-a596-f9c8a2224303 [ 763.114622] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.114828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.117471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.117471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.117471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.117471] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8390e1cc-f6af-47e5-a596-f9c8a2224303 already deleted. [ 763.117471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8390e1cc-f6af-47e5-a596-f9c8a2224303" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.363366] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.364729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.364729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.366040] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.371281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.371281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.371281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.371281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.372178] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.372232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.372904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.372904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.372904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.372904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.372904] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.401653] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.595331] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-884dca7a-b13c-46f8-be14-545d1ed9c984 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 763.595531] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-884dca7a-b13c-46f8-be14-545d1ed9c984 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 763.595748] env[65381]: INFO networking_nsxv3.common.synchronization [req-79e831c2-e620-4eaa-a36a-7b4d47106b7b req-884dca7a-b13c-46f8-be14-545d1ed9c984 service nova] Enqueued Resource ID: 9c10ede0-8ff0-40fd-b90a-41b807d208ff with Priority: HIGHEST for action port [ 763.596252] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 763.596409] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 763.596518] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c10ede0-8ff0-40fd-b90a-41b807d208ff with Priority: HIGHEST for action port [ 763.596798] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.596936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.598365] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.598491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.598721] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c10ede0-8ff0-40fd-b90a-41b807d208ff taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.598942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.598942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.599163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.599252] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c10ede0-8ff0-40fd-b90a-41b807d208ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.725654] env[65381]: INFO networking_nsxv3.common.synchronization [req-0c8d91f9-5fce-4080-93d7-d4ef903b8e0e req-fb5a3f14-107e-4886-a4c2-c08ce18b56a1 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_members [ 763.726023] env[65381]: INFO networking_nsxv3.common.synchronization [req-0c8d91f9-5fce-4080-93d7-d4ef903b8e0e req-fb5a3f14-107e-4886-a4c2-c08ce18b56a1 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 763.726023] env[65381]: INFO networking_nsxv3.common.synchronization [req-0c8d91f9-5fce-4080-93d7-d4ef903b8e0e req-fb5a3f14-107e-4886-a4c2-c08ce18b56a1 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 763.727113] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGHEST for action security_group_members [ 763.727113] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGHEST for action security_group_members [ 763.727113] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 763.727113] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b43997e-750b-4b84-8753-4d1519f37ae2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.727521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.727521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.727521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.727682] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.727682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.727682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.727836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.727919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.728055] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.728935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.729052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.729129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.729289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.729435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.729583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.729583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.729726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.729807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.729902] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.731843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.731843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.731843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.731843] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.865817] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.867944] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 413b19eb-94ec-489a-b47a-feaf8a84da43: rpc.has_security_group_logging(os_id): False [ 763.876649] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48eacb50-df32-446c-947a-a00fbf576caa: rpc.has_security_group_logging(os_id): False [ 763.891183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.891350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.891392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.891890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.891890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.891998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.892060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.892134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.893031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.893031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.893031] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be updated. [ 763.904494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b43997e-750b-4b84-8753-4d1519f37ae2: rpc.has_security_group_logging(os_id): False [ 763.906868] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.907021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.907309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.907543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.907729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.907997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.908172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.908272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.908576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.908685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.908951] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.909123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.909208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.909384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.909510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.909734] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.909858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.909937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.910152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.910270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.910379] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 763.930603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.930603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.930603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.930603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.930603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.930603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.931168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.931213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.931430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.931514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.931607] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 is going to be created. [ 763.976717] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.976873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.976946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.977194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.977347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.981296] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.981483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.981483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.981701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.981863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.000494] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.000645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.000705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.000914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.001287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.002854] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: IN_PROGRESS for 2s [ 764.004830] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 764.020868] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: IN_PROGRESS for 2s [ 764.101675] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c10ede0-8ff0-40fd-b90a-41b807d208ff with status ACTIVE [ 764.102061] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.102306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.102427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.102821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.102924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.103296] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.103432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.103472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.103659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.103742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.104259] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.104259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.104259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.104416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.104416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.104476] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c10ede0-8ff0-40fd-b90a-41b807d208ff is going to be updated. [ 764.151689] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.151880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.151935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.152180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.152476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.152541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c10ede0-8ff0-40fd-b90a-41b807d208ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.234290] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.235983] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.236184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.236242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.236616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.236716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.236928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.237045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.237110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.237265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.237369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.237423] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be updated. [ 764.238988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.239097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.239668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.239668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.239668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.239798] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.239883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.239979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.240735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.240735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.240735] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 is going to be updated. [ 764.285332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.285332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.285332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.285615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.285795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.287700] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.287893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.288056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.288281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.288451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.300565] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: IN_PROGRESS for 2s [ 764.300990] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: IN_PROGRESS for 2s [ 764.370745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.370745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.370745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.370745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.370745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.370745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 764.401205] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.401205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.401205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.401205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.401205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.415157] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 764.737476] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.925154] env[65381]: INFO networking_nsxv3.common.synchronization [None req-921aa8f9-d0b9-4cdf-9991-ed07d959df0c tempest-ServersTestManualDisk-1163278782 tempest-ServersTestManualDisk-1163278782-project-member] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_rules [ 764.925620] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_rules [ 764.926164] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.926415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.926468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.926817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.926971] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.992649] env[65381]: INFO networking_nsxv3.common.synchronization [None req-24ca8a12-d69f-4f41-b950-73066e457a5f None None] Enqueued Resource ID: 4a87323a-cc18-496e-8960-2eb5f8f30424 with Priority: HIGHEST for action port [ 764.993233] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a87323a-cc18-496e-8960-2eb5f8f30424 with Priority: HIGHEST for action port [ 764.993560] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a87323a-cc18-496e-8960-2eb5f8f30424 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.993690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a87323a-cc18-496e-8960-2eb5f8f30424" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.993758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a87323a-cc18-496e-8960-2eb5f8f30424" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.994014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a87323a-cc18-496e-8960-2eb5f8f30424" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.994897] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a87323a-cc18-496e-8960-2eb5f8f30424',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.023901] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e23b4344-c0b2-4182-b351-2a3b1d8ef4d5 tempest-ServersTestManualDisk-1163278782 tempest-ServersTestManualDisk-1163278782-project-member] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_rules [ 765.023901] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_rules [ 765.023901] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.024345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.240843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.241151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.241151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.241325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.241410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.241504] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 765.290314] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.290314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.290314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.290314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.290314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.301429] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 765.451769] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.451769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.452155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.452155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.452262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.452344] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 already deleted. [ 765.452457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.452654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.452881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.452968] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.496697] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a87323a-cc18-496e-8960-2eb5f8f30424 [ 765.496948] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.497417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.497417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.497417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.497757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.497757] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a87323a-cc18-496e-8960-2eb5f8f30424 already deleted. [ 765.497757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a87323a-cc18-496e-8960-2eb5f8f30424" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.658017] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 765.658017] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:1 started [ 765.977168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.977468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.977468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.977596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.977678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.977771] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 already deleted. [ 765.977852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.026787] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 766.027034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.027815] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 766.028017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.038990] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: SUCCESS [ 766.039245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.314984] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 in Status: SUCCESS [ 766.316253] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 deletion is rescheduled due to dependency. [ 766.316414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.317298] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 in Status: SUCCESS [ 766.317451] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 deletion is rescheduled due to dependency. [ 766.317545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.426593] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 766.427180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.427180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.427317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.427454] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.427573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.427636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.427787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.427889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.428019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.428599] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.428599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.428599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.428599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.429327] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.429327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.429327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.429327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.429327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.429327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.429327] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.430995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.430995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.430995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.430995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.430995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.430995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.430995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.430995] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.683344] env[65381]: INFO networking_nsxv3.common.synchronization [req-42b7dbde-32e1-45c8-a50b-8c956c421db1 req-793aaabf-08ab-45db-b853-c9ca8ede28e9 tempest-ServersAdminNegativeTestJSON-218141663 tempest-ServersAdminNegativeTestJSON-218141663-project-member] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 766.683947] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 766.686425] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.686425] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.686425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.686425] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.934335] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.935347] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e917637-f523-43f9-9811-f2b68b364eb6: rpc.has_security_group_logging(os_id): False [ 766.960114] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.960114] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.960114] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.960114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.960927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.960927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.960927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.962637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.962637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.962637] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be created. [ 767.019680] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.019968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.019968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.020125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.020312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.031381] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 767.119421] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-769 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.119681] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.119740] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.120017] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.120370] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.120597] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.120753] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.121257] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.121507] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.121810] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.122016] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.122210] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.122390] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.122573] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.122734] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.122885] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.150130] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.150306] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.150448] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.150601] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-769" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.150923] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-a2171bcf-272b-46bf-96f7-12f0b70f6620 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.151101] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.151216] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.151556] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.151693] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2171bcf-272b-46bf-96f7-12f0b70f6620',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.193679] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.314654] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 767.314864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.438748] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.658461] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.658785] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.658938] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.659248] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.659388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.659535] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port a2171bcf-272b-46bf-96f7-12f0b70f6620 not found, creating... [ 767.659830] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.659984] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.660180] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.660412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.660538] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.660838] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.662342] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.662469] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.662628] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.662765] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.664878] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: a2171bcf-272b-46bf-96f7-12f0b70f6620 is going to be created. [ 767.692904] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.693233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.693309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.693571] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.693812] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.698080] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.699087] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.942067] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.942269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.942364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.942586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.942673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.942775] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 768.002244] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.002244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.002244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.002795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.002795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.015221] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 768.200893] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.201260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.201260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.201524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.201683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.201855] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be updated. [ 768.238130] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.238321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.238469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.238720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.238928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.251222] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 768.431903] env[65381]: INFO networking_nsxv3.common.synchronization [req-42b7dbde-32e1-45c8-a50b-8c956c421db1 req-0af614c3-81be-4a7f-83f2-d6783d75fd3c service nova] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_rules [ 768.432102] env[65381]: INFO networking_nsxv3.common.synchronization [req-42b7dbde-32e1-45c8-a50b-8c956c421db1 req-0af614c3-81be-4a7f-83f2-d6783d75fd3c service nova] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 768.432279] env[65381]: INFO networking_nsxv3.common.synchronization [req-42b7dbde-32e1-45c8-a50b-8c956c421db1 req-0af614c3-81be-4a7f-83f2-d6783d75fd3c service nova] Enqueued Resource ID: a2171bcf-272b-46bf-96f7-12f0b70f6620 with Priority: HIGHEST for action port [ 768.432549] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_rules [ 768.432634] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 768.432731] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2171bcf-272b-46bf-96f7-12f0b70f6620 with Priority: HIGHEST for action port [ 768.434788] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.434995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.435054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.435231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.435320] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.439028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.439028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.439028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2171bcf-272b-46bf-96f7-12f0b70f6620 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.439028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.439028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.439028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.439028] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2171bcf-272b-46bf-96f7-12f0b70f6620',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.897111] env[65381]: INFO networking_nsxv3.common.synchronization [req-689fb1df-1cb6-47f2-87f5-b498f9a2fde5 req-284b2ea9-3f42-45c1-b462-781c41eebe74 tempest-ServerAddressesTestJSON-900036973 tempest-ServerAddressesTestJSON-900036973-project-member] Enqueued Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_members [ 768.897111] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGHEST for action security_group_members [ 768.897111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.897235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.897235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.898059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.898059] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.898059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.898059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.898268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.898268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.898336] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.939490] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.939623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.939796] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2171bcf-272b-46bf-96f7-12f0b70f6620 with status ACTIVE [ 768.939970] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.940089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.940162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.940379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.940465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.940639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.940738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.941335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.941335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.941335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.941335] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.941522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.941688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.941915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.942069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.942560] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2171bcf-272b-46bf-96f7-12f0b70f6620 is going to be updated. [ 768.979565] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.979709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.979770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.980205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.980287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.980477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2171bcf-272b-46bf-96f7-12f0b70f6620" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.044211] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 769.044513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.045068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.045291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.045381] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.403478] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.403478] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.403478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.403478] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 is going to be updated. [ 769.446336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.446336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.446336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.446336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.446336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.456869] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 in Status: IN_PROGRESS for 2s [ 769.549123] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.549205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.906443] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c3538a39-4da0-425c-bf09-7e1116d3d6de None None] Enqueued Resource ID: 9f346c56-a77b-4ac0-9b02-fee6d9745d08 with Priority: HIGHEST for action port [ 769.907390] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f346c56-a77b-4ac0-9b02-fee6d9745d08 with Priority: HIGHEST for action port [ 769.910035] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f346c56-a77b-4ac0-9b02-fee6d9745d08 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.910035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f346c56-a77b-4ac0-9b02-fee6d9745d08" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.910035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f346c56-a77b-4ac0-9b02-fee6d9745d08" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.910035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f346c56-a77b-4ac0-9b02-fee6d9745d08" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.910035] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f346c56-a77b-4ac0-9b02-fee6d9745d08',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.036569] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 770.036786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.036958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.037226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.037493] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.037614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.037614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.037799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.037866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.037955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.038054] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.261997] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 770.261997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.261997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.261997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.261997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.261997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.261997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.262361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.262361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.262361] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.411324] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f346c56-a77b-4ac0-9b02-fee6d9745d08 [ 770.411624] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.411687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.411735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.411947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.412049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.412205] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f346c56-a77b-4ac0-9b02-fee6d9745d08 already deleted. [ 770.412298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f346c56-a77b-4ac0-9b02-fee6d9745d08" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.541430] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.542352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.542352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.542352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.542352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.542352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.542720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.542771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.542867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.542996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.543274] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.543412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.543494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.544113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.544113] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.544113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.544224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.544468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.544636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.544756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.544877] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.766601] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.049907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e917637-f523-43f9-9811-f2b68b364eb6: rpc.has_security_group_logging(os_id): False [ 771.078934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.079128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.079278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.079442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.079545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.079738] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.079883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.079984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.080247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.080354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.080638] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.080769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.080823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.080943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.081028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.081330] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.081449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.081514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.081676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.081753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.081839] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 771.165745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.165745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.165745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.165745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.165745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.178830] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 771.274055] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.469861] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 in Status: SUCCESS [ 771.470279] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 deletion is rescheduled due to dependency. [ 771.470279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.776427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.776652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.776721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.776922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.777020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.777213] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be updated. [ 771.811336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.811716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.812033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.812389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.812636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.824780] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 772.278726] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5841ae5b-a970-4361-922f-7af6e33d7d8d None None] Enqueued Resource ID: ef856dce-e8aa-4c7c-b741-5dad82b427c4 with Priority: HIGHEST for action port [ 772.279424] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef856dce-e8aa-4c7c-b741-5dad82b427c4 with Priority: HIGHEST for action port [ 772.279690] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef856dce-e8aa-4c7c-b741-5dad82b427c4 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.279876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef856dce-e8aa-4c7c-b741-5dad82b427c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.279876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef856dce-e8aa-4c7c-b741-5dad82b427c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.280541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef856dce-e8aa-4c7c-b741-5dad82b427c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.280651] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef856dce-e8aa-4c7c-b741-5dad82b427c4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.579214] env[65381]: INFO networking_nsxv3.common.synchronization [req-8e54f53f-40b1-4b6a-8609-d7917336a6a4 req-faea2b22-0b6f-4739-89a7-014b15269adc tempest-ServersV294TestFqdnHostnames-1279301147 tempest-ServersV294TestFqdnHostnames-1279301147-project-member] Enqueued Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_members [ 772.579790] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 with Priority: HIGHEST for action security_group_members [ 772.580360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b334e63-c2b8-4d02-9110-c8fc60d33c13 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.580683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.580683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.581643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.581804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.581912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.581979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.582920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.582920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.582920] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b334e63-c2b8-4d02-9110-c8fc60d33c13',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.784425] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef856dce-e8aa-4c7c-b741-5dad82b427c4 [ 772.784677] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.784895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.784895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.786575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.786575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.786575] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef856dce-e8aa-4c7c-b741-5dad82b427c4 already deleted. [ 772.786575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef856dce-e8aa-4c7c-b741-5dad82b427c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.086405] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.086601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.086675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.086937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.087051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.087265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.087392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.087429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.087576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.087663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.087778] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 is going to be updated. [ 773.126094] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.126265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.126330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.126678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.126788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.142259] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 in Status: IN_PROGRESS for 2s [ 773.204217] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 773.204217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.204217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.204217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.204217] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.709180] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.709511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.709583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.710075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.710535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.710535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.710535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.710853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.710967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.711098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.711288] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.837045] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 773.837045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.837681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.837681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.837681] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.837819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.837852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.838036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.838127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.838208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.838338] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.215523] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.216289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.216289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.216289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.216289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.216289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.216569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.216569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.216569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.216661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.216804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.217176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.217176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.217176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.217278] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.217324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.217530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.217530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.217635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.217680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.217733] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.292951] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc09433d-645a-405b-be24-2fd2e921beab req-325214af-0586-4609-858b-8609ff3034ab tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 774.293726] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 774.294987] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.295326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.296545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.296929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.297241] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.297506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.297680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.298142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.298341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.299421] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.341095] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.341234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.342082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.342082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.342082] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.342082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.342082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.342082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.342082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.342409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.342409] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.342409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.342519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.342615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.342727] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.342819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.342879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.343042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.343123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.343224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.343336] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.722620] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.722932] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.722932] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.723651] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.723651] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.725295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.725441] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.725800] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.725982] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.726327] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.726775] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.726775] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.726951] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.727106] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.727161] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.727297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.728852] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e917637-f523-43f9-9811-f2b68b364eb6: rpc.has_security_group_logging(os_id): False [ 774.750493] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.750493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.750493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.750729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.750729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.751435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.751435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.751435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.751435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.751435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.752065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.752065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.752065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.752065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.752065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.752065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.752526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.752526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.752526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.752526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.752526] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 774.754542] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.754702] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.754702] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.754972] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.755187] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-a4df640f-48ae-4003-b95f-5d02f313d5e5 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.755295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.755491] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.755657] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.755782] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4df640f-48ae-4003-b95f-5d02f313d5e5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.801356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.803615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.803714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.803966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.804094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.804358] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.804474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.804534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.804735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.804825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.804937] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 already deleted. [ 774.805028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.840392] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.840392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.840392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.840392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.840627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.846725] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc: rpc.has_security_group_logging(os_id): False [ 774.857560] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 774.864043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.864183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.864242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.864523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.864659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.864860] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.864956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.865406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.865406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.865406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.865587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.865587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.865587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.865730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.865792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.866034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.866950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.867030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.867220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.868121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.868254] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be updated. [ 774.966550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.966840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.967013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.967189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.967601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.995258] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 775.151922] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 in Status: SUCCESS [ 775.152285] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b334e63-c2b8-4d02-9110-c8fc60d33c13 deletion is rescheduled due to dependency. [ 775.152430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b334e63-c2b8-4d02-9110-c8fc60d33c13" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.258708] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.258708] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.258708] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.259070] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.259200] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.259488] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port a4df640f-48ae-4003-b95f-5d02f313d5e5 not found, creating... [ 775.259739] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.259976] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.260137] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.260630] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.260699] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.261086] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.261310] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.261481] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.261755] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.261945] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.262148] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: a4df640f-48ae-4003-b95f-5d02f313d5e5 is going to be created. [ 775.287685] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.288073] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.288256] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.288886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.289036] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.289753] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.035529] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc09433d-645a-405b-be24-2fd2e921beab req-e61890a4-ca24-445a-9d20-28cad2f79cc3 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 776.035783] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc09433d-645a-405b-be24-2fd2e921beab req-e61890a4-ca24-445a-9d20-28cad2f79cc3 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 776.035944] env[65381]: INFO networking_nsxv3.common.synchronization [req-bc09433d-645a-405b-be24-2fd2e921beab req-e61890a4-ca24-445a-9d20-28cad2f79cc3 service nova] Enqueued Resource ID: a4df640f-48ae-4003-b95f-5d02f313d5e5 with Priority: HIGHEST for action port [ 776.036699] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 776.036926] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 776.041544] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4df640f-48ae-4003-b95f-5d02f313d5e5 with Priority: HIGHEST for action port [ 776.042541] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.042541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.042541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.042770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.042770] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.043894] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.044062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.044142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.044345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.044513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.044645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.044740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.044869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.044959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.045101] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.046422] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4df640f-48ae-4003-b95f-5d02f313d5e5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.046556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.046622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.046784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.046868] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4df640f-48ae-4003-b95f-5d02f313d5e5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.554520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.554694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.554852] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.555824] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4df640f-48ae-4003-b95f-5d02f313d5e5 with status ACTIVE [ 776.555978] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.556086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.556144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.556435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.556435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.556605] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.556716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.556762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.556915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.556991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.558207] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.559064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.559064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.559064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.559064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.559064] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4df640f-48ae-4003-b95f-5d02f313d5e5 is going to be updated. [ 776.585128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.585305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.585441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.585633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.585770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.585937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4df640f-48ae-4003-b95f-5d02f313d5e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.875678] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 776.876191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.010651] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 777.010926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.061514] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.193269] env[65381]: INFO networking_nsxv3.common.synchronization [req-ee73782e-005c-4a0f-acf9-d81fc751b717 req-13f26430-7a0b-4304-b803-ec58c0e12aef tempest-ServersTestJSON-345764332 tempest-ServersTestJSON-345764332-project-member] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_members [ 777.194748] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_members [ 777.195370] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.195370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.195617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.195789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.195995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.196150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.196223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.196771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.196771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.196771] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.568768] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.568768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.568768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.568768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.568768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.568768] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be created. [ 777.597590] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.597590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.597590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.597590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.597590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.621099] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: UNINITIALIZED for 2s [ 777.675139] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0fde4ca-676c-4744-bae8-0919376967db req-6e4da6f5-e7d0-41f4-871f-6f8fec08a55c tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 777.675139] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 777.675710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.675898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.676011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.676328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.676567] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.676726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.676826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.677077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.677213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.677360] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.708075] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.708075] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.708075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d already deleted. [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.708075] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-191 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-191" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.708075] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-191" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.708728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-191" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.708728] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.708728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.708728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.708728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.708728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.708728] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.708728] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.708728] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.708728] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.708728] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.708728] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.708728] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.734264] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.734586] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.734821] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.735111] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-191" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.735534] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.736092] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.736853] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.736853] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.736853] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ef7f6b-c5aa-4847-9478-3b5d84d7f08f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.181024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.230623] env[65381]: INFO networking_nsxv3.common.synchronization [req-9b649d40-535b-48f6-bb0f-0b4fdd6939be req-23a7d885-4c7f-42f2-be86-5a9a52d6cfc3 tempest-ListImageFiltersTestJSON-1885631896 tempest-ListImageFiltersTestJSON-1885631896-project-member] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 778.231300] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 778.231630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.231724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.231795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.231998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.232393] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.232575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.232670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.232871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.232990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.233134] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.238801] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.239057] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.239187] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.239363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.239504] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.239652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 94ef7f6b-c5aa-4847-9478-3b5d84d7f08f not found, creating... [ 778.239925] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.240134] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.240268] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.240484] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.240614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.240889] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.241053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.241166] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.241366] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.241494] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.241629] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 94ef7f6b-c5aa-4847-9478-3b5d84d7f08f is going to be created. [ 778.267127] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.267341] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.267466] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.268055] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.268185] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.268358] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.500227] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0fde4ca-676c-4744-bae8-0919376967db req-4a39d388-dcbc-4638-bf6b-3b99135a5f4e tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 778.500735] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 778.501101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.502223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.686993] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.736481] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.015268] env[65381]: INFO networking_nsxv3.common.synchronization [req-ee73782e-005c-4a0f-acf9-d81fc751b717 req-d158795c-171d-4bf0-8699-9bd538a4ddba service nova] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_rules [ 779.015476] env[65381]: INFO networking_nsxv3.common.synchronization [req-ee73782e-005c-4a0f-acf9-d81fc751b717 req-d158795c-171d-4bf0-8699-9bd538a4ddba service nova] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_members [ 779.019023] env[65381]: INFO networking_nsxv3.common.synchronization [req-ee73782e-005c-4a0f-acf9-d81fc751b717 req-d158795c-171d-4bf0-8699-9bd538a4ddba service nova] Enqueued Resource ID: 94ef7f6b-c5aa-4847-9478-3b5d84d7f08f with Priority: HIGHEST for action port [ 779.019023] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_rules [ 779.019023] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_members [ 779.019023] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ef7f6b-c5aa-4847-9478-3b5d84d7f08f with Priority: HIGHEST for action port [ 779.019023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.019023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.019023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.019023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.019023] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.019626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.019626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.019703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.020861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.020861] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.020861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.020861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.020861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.020861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.020861] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.022069] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.022069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.022069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.022069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.022069] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94ef7f6b-c5aa-4847-9478-3b5d84d7f08f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.116503] env[65381]: INFO networking_nsxv3.common.synchronization [req-a0fde4ca-676c-4744-bae8-0919376967db req-48bdb9ee-a7c3-44ab-a435-93fb42eac02d tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 779.116816] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 779.121562] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.121562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.191271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.192487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.192487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.192487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.192487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.192487] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 779.223639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.223855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.223934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.224171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.224481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.235467] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 779.237864] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.527628] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94ef7f6b-c5aa-4847-9478-3b5d84d7f08f with status ACTIVE [ 779.528871] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.529138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.529242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.529541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.529681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.529971] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.531735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.531882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.532214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.532420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.532999] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.532999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.532999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.532999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.533292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.533387] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94ef7f6b-c5aa-4847-9478-3b5d84d7f08f is going to be updated. [ 779.534620] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.537816] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.538018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.560886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.561067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.561153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.561358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.561499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.561655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94ef7f6b-c5aa-4847-9478-3b5d84d7f08f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.636213] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.642605] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.642605] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.740966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.741258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.741325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.741667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.741908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.741908] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be updated. [ 779.800515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.800735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.800843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.801169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.801377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.814331] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: IN_PROGRESS for 2s [ 780.040023] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.079424] env[65381]: INFO networking_nsxv3.common.synchronization [req-22cf22c9-76b0-44cd-ad06-90933e4dc6a1 req-e683d079-6e9c-47e7-b422-fcc826e7afd3 tempest-VolumesAdminNegativeTest-1385301175 tempest-VolumesAdminNegativeTest-1385301175-project-member] Enqueued Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_members [ 780.080281] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_members [ 780.080656] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.080820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.080893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.081231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.081405] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.081513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.081580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.081745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.081814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.081915] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.145765] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.146316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.146461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.146812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.147287] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.147573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.147745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.148069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.148220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.148351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.148601] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.148803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.148910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.149121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.149262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.149372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.149437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.149598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.149680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.149764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.149855] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.542882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.543296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.543296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.544901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.544901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.544901] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d is going to be created. [ 780.549956] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.550267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-309" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.550267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-309" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.550587] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-309" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.550839] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.551103] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.551205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.551574] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.551660] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.552118] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.552212] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.552491] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.552672] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.552854] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.552999] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.553320] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.573660] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.573660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.573921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.574033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.574372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.581495] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.581683] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.581818] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.582009] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-309" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.582380] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-692b081a-f9de-4936-a3c8-01c4f8726b81 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.582576] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.582671] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.583052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.583236] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692b081a-f9de-4936-a3c8-01c4f8726b81',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.584417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.584555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.584619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.584802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.585723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.585723] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.585723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.585723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.585723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.585723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.585723] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e500f09-f228-4346-a756-40b98d2928da already deleted. [ 780.585723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.586985] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: UNINITIALIZED for 2s [ 780.656464] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9c03ef0-b5e2-4757-9488-6558cc6e9841: rpc.has_security_group_logging(os_id): False [ 780.679841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.680046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.680090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.680467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.680531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.680748] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.680857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.680923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.681113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.681211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.681593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.681702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.681770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.681948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.682044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.682307] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.682428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.682507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.682657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.682734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.682820] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be created. [ 780.764229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.764229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.764229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.764229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.764229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.776236] env[65381]: INFO networking_nsxv3.common.synchronization [None req-bfe4dd49-36ac-4839-b70e-e9baa55a6434 None None] Enqueued Resource ID: 2a385151-44b6-4665-97f4-96b7548217c1 with Priority: HIGHEST for action port [ 780.776861] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a385151-44b6-4665-97f4-96b7548217c1 with Priority: HIGHEST for action port [ 780.777405] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a385151-44b6-4665-97f4-96b7548217c1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.777477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a385151-44b6-4665-97f4-96b7548217c1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.777511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a385151-44b6-4665-97f4-96b7548217c1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.777803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a385151-44b6-4665-97f4-96b7548217c1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.777888] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a385151-44b6-4665-97f4-96b7548217c1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.801181] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 781.087882] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.088296] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.088489] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.088837] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.089023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.089196] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 692b081a-f9de-4936-a3c8-01c4f8726b81 not found, creating... [ 781.089514] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.089776] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.089855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.090126] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.090271] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.090646] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.090810] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.090926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.091566] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.091835] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.092053] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 692b081a-f9de-4936-a3c8-01c4f8726b81 is going to be created. [ 781.118325] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.118325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.118325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.118325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.118325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.118568] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.252687] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 781.252930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.253222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.253474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.254069] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.254069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.254069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.254069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.254574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.254574] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.281905] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a385151-44b6-4665-97f4-96b7548217c1 [ 781.281905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.281905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.281905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.281905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.281905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.281905] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a385151-44b6-4665-97f4-96b7548217c1 already deleted. [ 781.281905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a385151-44b6-4665-97f4-96b7548217c1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.760180] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.760614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.760614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.760697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.760827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.761047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.761195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.761275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.761461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.761550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.761658] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 781.816972] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.817205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.817205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.817422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.817558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.830474] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 781.833583] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 781.833821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.966417] env[65381]: INFO networking_nsxv3.common.synchronization [req-22cf22c9-76b0-44cd-ad06-90933e4dc6a1 req-f6c55272-7518-47c2-8fc4-068ba2dbb778 service nova] Enqueued Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_rules [ 781.966417] env[65381]: INFO networking_nsxv3.common.synchronization [req-22cf22c9-76b0-44cd-ad06-90933e4dc6a1 req-f6c55272-7518-47c2-8fc4-068ba2dbb778 service nova] Enqueued Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_members [ 781.970042] env[65381]: INFO networking_nsxv3.common.synchronization [req-22cf22c9-76b0-44cd-ad06-90933e4dc6a1 req-f6c55272-7518-47c2-8fc4-068ba2dbb778 service nova] Enqueued Resource ID: 692b081a-f9de-4936-a3c8-01c4f8726b81 with Priority: HIGHEST for action port [ 781.970042] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_rules [ 781.970042] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_members [ 781.970042] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 692b081a-f9de-4936-a3c8-01c4f8726b81 with Priority: HIGHEST for action port [ 781.970042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.970042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.970042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.970042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.970042] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.975166] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.975166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.975166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.975166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.975343] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.975531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.975531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.975746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.975856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.975985] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.977161] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-692b081a-f9de-4936-a3c8-01c4f8726b81 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.977294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.978576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.978576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.978576] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('692b081a-f9de-4936-a3c8-01c4f8726b81',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.477031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.477031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.483787] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.487025] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 692b081a-f9de-4936-a3c8-01c4f8726b81 with status ACTIVE [ 782.487025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.487025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.487025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.487025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.487025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.487025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.487025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.487025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.487767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.487767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.487767] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.487896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.487928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.488176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.488308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.488487] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 692b081a-f9de-4936-a3c8-01c4f8726b81 is going to be updated. [ 782.519377] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.519377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.519505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.519708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.519927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.520162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-692b081a-f9de-4936-a3c8-01c4f8726b81" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.605069] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: SUCCESS [ 782.605069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.605355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.605523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.605784] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.605943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.606025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.606259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.606371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.606483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.606616] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.823027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 782.823027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.916728] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ddfa9eb-00da-41ca-8ca3-62a52ae3de2e req-539a2835-c67f-4b32-8354-965ebbe0ee63 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 782.917427] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 782.917759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.917879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.917941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.918216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.918364] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.918460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.918517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.918695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.918776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.918883] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.991793] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.109902] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.276508] env[65381]: INFO networking_nsxv3.common.synchronization [None req-eeb57393-bf76-44ef-b15d-d3225e5aa923 tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_rules [ 783.277972] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_rules [ 783.277972] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.278141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.278215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.278462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.278693] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.352942] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.353171] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.353285] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.353671] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.354245] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.354245] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.354420] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.354596] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.354741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.355048] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.355477] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.355540] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.355638] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.355800] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.356080] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.356080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.380174] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.380403] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.380559] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.380770] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.381173] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-030f325c-52cd-4a68-9014-c02c5a99ad06 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.381375] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.381975] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.381975] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.382150] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('030f325c-52cd-4a68-9014-c02c5a99ad06',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.421307] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.421493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.421668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.422107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.422107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.422415] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.422600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.422686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.422978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.423164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.423427] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d already deleted. [ 783.423556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.447263] env[65381]: INFO networking_nsxv3.common.synchronization [None req-62baa00f-bcde-4d3e-ab8a-96028c8002f8 tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_rules [ 783.447263] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_rules [ 783.447521] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.447763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.497449] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.497449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.497449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.497449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.497449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.497449] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e500f09-f228-4346-a756-40b98d2928da is going to be created. [ 783.536183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.536518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.536518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.537927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.537927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.549180] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e500f09-f228-4346-a756-40b98d2928da in Status: UNINITIALIZED for 2s [ 783.612488] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb70f39c-753b-4f89-a31c-4120096fef6d: rpc.has_security_group_logging(os_id): False [ 783.646535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.646535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.646535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.646535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.646535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.646535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.647153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.647153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.647153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.647153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.647153] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d is going to be created. [ 783.731267] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.731614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.731754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.732106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.732348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.751911] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: IN_PROGRESS for 2s [ 783.822449] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.822873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.822873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.823019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.825185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.825185] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 already deleted. [ 783.825185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.825185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.825185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.825185] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.845979] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 783.845979] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 deletion is rescheduled due to dependency. [ 783.845979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.846594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.846594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.846890] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.847338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.847338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.848423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.848423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.848423] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.885036] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.885284] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.885408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.885698] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.885843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.886045] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 030f325c-52cd-4a68-9014-c02c5a99ad06 not found, creating... [ 783.886377] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.886575] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.886672] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.886931] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.888563] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.888563] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.888728] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.888781] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.889256] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.889368] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.890055] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 030f325c-52cd-4a68-9014-c02c5a99ad06 is going to be created. [ 783.913097] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.913335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.913550] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.913758] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.914165] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.914412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.050300] env[65381]: INFO networking_nsxv3.common.synchronization [None req-9a67603f-adc9-4fdc-8e61-14eea59ba488 None None] Enqueued Resource ID: fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21 with Priority: HIGHEST for action port [ 784.051410] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21 with Priority: HIGHEST for action port [ 784.051532] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.051852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.051852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.052109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.052213] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.350429] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.350582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.350674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.350891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.350981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.351091] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 already deleted. [ 784.351186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.351503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.351634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.351708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.351870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.351983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.352175] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.352278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.352346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.352524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.352607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.353323] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 784.381586] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.381799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.381799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.382021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.382161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.392807] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 784.554581] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21 [ 784.554829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.555054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.555054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.555260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.555348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.555441] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21 already deleted. [ 784.555523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fecef1cd-37d8-4dba-ac39-5b3cd5dc4a21" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.640592] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ddfa9eb-00da-41ca-8ca3-62a52ae3de2e req-80fbf845-4ebb-4387-b67b-cefc15f7bb62 service nova] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 784.640755] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ddfa9eb-00da-41ca-8ca3-62a52ae3de2e req-80fbf845-4ebb-4387-b67b-cefc15f7bb62 service nova] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 784.640879] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ddfa9eb-00da-41ca-8ca3-62a52ae3de2e req-80fbf845-4ebb-4387-b67b-cefc15f7bb62 service nova] Enqueued Resource ID: 030f325c-52cd-4a68-9014-c02c5a99ad06 with Priority: HIGHEST for action port [ 784.643911] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 784.643911] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 784.643911] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 030f325c-52cd-4a68-9014-c02c5a99ad06 with Priority: HIGHEST for action port [ 784.644159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.644225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.644278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.644510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.644603] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.645826] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.646010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.646099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.646339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.646544] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.652275] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.652275] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-030f325c-52cd-4a68-9014-c02c5a99ad06 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.652275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.652275] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('030f325c-52cd-4a68-9014-c02c5a99ad06',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.154812] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.155216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.155216] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.156254] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 030f325c-52cd-4a68-9014-c02c5a99ad06 with status ACTIVE [ 785.156492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.156626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.156685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.156908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.157332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.157332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.157577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.157577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.157734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.157804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.157981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.158088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.158140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.158311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.158388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.158476] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 030f325c-52cd-4a68-9014-c02c5a99ad06 is going to be updated. [ 785.180483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.180612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.180654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.181317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.181317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.181317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-030f325c-52cd-4a68-9014-c02c5a99ad06" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.561672] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e500f09-f228-4346-a756-40b98d2928da in Status: SUCCESS [ 785.561672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.561672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.561942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.562048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.562175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.562370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.562551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.562637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.562730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.562811] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.660561] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.770695] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: SUCCESS [ 785.770930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.065176] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.065360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.065458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.065698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.065881] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.066208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.066208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.066208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.066312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.066373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.066520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.066619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.066682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.066834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.067049] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.067176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.067176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.067279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.067364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.067439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.067529] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.166639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.167175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.167175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.167175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.167175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.167175] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be created. [ 786.194098] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.194264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.194326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.194533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.194694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.205538] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: UNINITIALIZED for 2s [ 786.405448] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 786.405745] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 deletion is rescheduled due to dependency. [ 786.405846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.570275] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e500f09-f228-4346-a756-40b98d2928da: rpc.has_security_group_logging(os_id): False [ 786.592905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.593119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.593228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.593533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.593720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.594318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.594379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.594444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.594620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.594728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.595152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.596611] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.596611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.596611] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e500f09-f228-4346-a756-40b98d2928da is going to be created. [ 786.661305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.661305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.661305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.661305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.661305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.677084] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e500f09-f228-4346-a756-40b98d2928da in Status: IN_PROGRESS for 2s [ 788.222186] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 788.222186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.222186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.222186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.222663] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.222663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.222748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.222884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.222961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.223068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.223162] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.692206] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e500f09-f228-4346-a756-40b98d2928da in Status: SUCCESS [ 788.692206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.725400] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.089882] env[65381]: INFO networking_nsxv3.common.synchronization [req-0ec2eb78-b2fe-45d8-93b0-d63e27a4f62c req-3e0fbd2c-577b-47d5-b956-e68955b06605 tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 789.090628] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 789.090977] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.091346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.091346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.092994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.092994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.092994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.092994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.092994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.092994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.092994] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.229231] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9694af19-2e42-4299-8799-3ccc40da653d: rpc.has_security_group_logging(os_id): False [ 789.255468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.255691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.255778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.256114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.256246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.256538] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.256701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.256817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.258135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.258135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.258135] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be created. [ 789.339266] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.339447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.339447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.339634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.339967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.365648] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 789.497540] env[65381]: INFO networking_nsxv3.common.synchronization [req-31e12b24-d479-40a9-9c16-46ff321c926d req-25dabd31-556a-49d2-8b88-e70721ddb1d8 tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 789.498109] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 789.498431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.498556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.498621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.498831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.499016] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.499127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.499190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.499351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.499436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.499531] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.598151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.598151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.598151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.598151] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 789.634365] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.634365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.634365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.634365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.634365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.644363] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 790.002097] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.504010] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.007668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.008261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.008385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.009170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.009309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.010030] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 791.047763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.049162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.049162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.049162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.049162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.058929] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 791.218116] env[65381]: INFO networking_nsxv3.common.synchronization [req-e8d68c29-9935-4445-a35c-5abfe65da094 req-7cf6b046-810d-4c03-9d8c-ae147141c943 tempest-ListServerFiltersTestJSON-1861833264 tempest-ListServerFiltersTestJSON-1861833264-project-member] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 791.218717] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 791.219093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.219280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.219407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.219706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.219915] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.220207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.220207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.220388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.220572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.220633] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.381605] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 791.381829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.658327] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 791.658647] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb deletion is rescheduled due to dependency. [ 791.658798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.682803] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.682992] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.683221] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.683577] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.684298] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.684298] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.684298] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.684478] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.684651] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.685298] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.685298] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.685298] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.685298] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.685298] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.685298] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.686906] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.705927] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.707739] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.707739] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.707949] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.708534] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-591af385-8412-48f8-b0d9-f87deafabe8b taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.708847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.709090] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.709366] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.709610] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('591af385-8412-48f8-b0d9-f87deafabe8b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.722937] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.722937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.722937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.723182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.723386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.724167] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.724167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.724167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.724167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.724167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.724167] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a already deleted. [ 791.724601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.211929] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.212175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.212299] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.212637] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.212783] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.212929] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 591af385-8412-48f8-b0d9-f87deafabe8b not found, creating... [ 792.213200] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.213356] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.213467] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.213719] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.213851] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.214146] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.214297] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.214409] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.214813] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.214813] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.214924] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 591af385-8412-48f8-b0d9-f87deafabe8b is going to be created. [ 792.236020] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.236402] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.236593] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.236858] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.237096] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.237318] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.963075] env[65381]: INFO networking_nsxv3.common.synchronization [req-e8d68c29-9935-4445-a35c-5abfe65da094 req-38f7c161-aa68-4c15-88ba-2a80bde1e49e service nova] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_rules [ 792.963329] env[65381]: INFO networking_nsxv3.common.synchronization [req-e8d68c29-9935-4445-a35c-5abfe65da094 req-38f7c161-aa68-4c15-88ba-2a80bde1e49e service nova] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 792.964630] env[65381]: INFO networking_nsxv3.common.synchronization [req-e8d68c29-9935-4445-a35c-5abfe65da094 req-38f7c161-aa68-4c15-88ba-2a80bde1e49e service nova] Enqueued Resource ID: 591af385-8412-48f8-b0d9-f87deafabe8b with Priority: HIGHEST for action port [ 792.964630] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_rules [ 792.964630] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 792.964630] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591af385-8412-48f8-b0d9-f87deafabe8b with Priority: HIGHEST for action port [ 792.964630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.966452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.966570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.966944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.967088] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.968401] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.968573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.968786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.969073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.969262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.969365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.971445] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.971830] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-591af385-8412-48f8-b0d9-f87deafabe8b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.971830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.971974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.972065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.972142] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('591af385-8412-48f8-b0d9-f87deafabe8b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.070863] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 793.070863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.236669] env[65381]: INFO networking_nsxv3.common.synchronization [req-7355d389-ec8c-4f37-a7c2-dedc9be3e9e6 req-529c7d63-18d1-401a-b86e-77676c81fdea tempest-ServersAdminNegativeTestJSON-218141663 tempest-ServersAdminNegativeTestJSON-218141663-project-member] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 793.236772] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 793.237104] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.237226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.237296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.238204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.238374] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.238693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.238693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.238808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.239156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.239156] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.330538] env[65381]: INFO networking_nsxv3.common.synchronization [None req-17939e0f-ffd9-4871-a56d-7a54c4205ed2 None None] Enqueued Resource ID: 42d7b724-4e7a-4a78-b87f-11d4d14d4150 with Priority: HIGHEST for action port [ 793.331414] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d7b724-4e7a-4a78-b87f-11d4d14d4150 with Priority: HIGHEST for action port [ 793.332862] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d7b724-4e7a-4a78-b87f-11d4d14d4150 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.333053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d7b724-4e7a-4a78-b87f-11d4d14d4150" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.333127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d7b724-4e7a-4a78-b87f-11d4d14d4150" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.333462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d7b724-4e7a-4a78-b87f-11d4d14d4150" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.333539] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d7b724-4e7a-4a78-b87f-11d4d14d4150',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.476451] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.478116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.478282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.479467] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 591af385-8412-48f8-b0d9-f87deafabe8b with status ACTIVE [ 793.479736] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.480492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.481216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.482187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.482979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.483271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.483834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.485825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.487118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.487118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.487118] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.487118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.487118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.487118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.487446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.487446] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 591af385-8412-48f8-b0d9-f87deafabe8b is going to be updated. [ 793.516057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.516057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.516057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.516057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.516057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.516057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-591af385-8412-48f8-b0d9-f87deafabe8b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.611579] env[65381]: INFO networking_nsxv3.common.synchronization [req-654f6a2b-e062-4a40-b1a9-0c92d0d85f60 req-98db3896-74c7-4f9c-8128-fae950e89bf7 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 793.612393] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 793.612729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.612886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.612948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.613183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.613371] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.613477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.613538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.613696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.613775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.613870] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.741197] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.836568] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42d7b724-4e7a-4a78-b87f-11d4d14d4150 [ 793.836841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.837014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.837120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.837393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.837458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.837566] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42d7b724-4e7a-4a78-b87f-11d4d14d4150 already deleted. [ 793.837676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d7b724-4e7a-4a78-b87f-11d4d14d4150" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.919956] env[65381]: INFO networking_nsxv3.common.synchronization [req-286762aa-dac6-47eb-801b-fe8dcb3af58c req-28bde37c-96ae-458c-9d62-993fa76d5bf9 tempest-ListServerFiltersTestJSON-1861833264 tempest-ListServerFiltersTestJSON-1861833264-project-member] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 793.920557] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 793.920814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.921601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.978527] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.121889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.121889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.121889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.122568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.122568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.122568] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.122568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.122568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.122776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.122776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.122776] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 794.158388] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.158585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.158652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.158864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.159011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.182080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 794.244717] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.384148] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.385942] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.385942] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.385942] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.385942] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.385942] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.386799] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.387150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.387726] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.387726] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.387726] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.387848] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.387926] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.388019] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.388173] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.388464] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.413724] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.413893] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.414041] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.414207] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.414526] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.414694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.414809] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.415162] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.415304] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b895fc5-3925-41c3-9d3a-bcb409db9cb0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.483802] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.483802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.483802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.483802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.483802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.483802] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be created. [ 794.515159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.515443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.515443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.515564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.515732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.530122] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: UNINITIALIZED for 2s [ 794.747759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.747921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.747921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.748831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.748831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.748831] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be updated. [ 794.802045] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.802045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.802045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.802349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.802349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.814536] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 794.918430] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.919372] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.919372] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.919372] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.919535] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.919629] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 5b895fc5-3925-41c3-9d3a-bcb409db9cb0 not found, creating... [ 794.920032] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.920329] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.920447] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.920715] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.920898] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.921231] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.921429] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.921572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.921811] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.922315] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.922315] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 5b895fc5-3925-41c3-9d3a-bcb409db9cb0 is going to be created. [ 794.943474] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.944304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.944304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.944304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.944411] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.944578] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.147846] env[65381]: INFO networking_nsxv3.common.synchronization [None req-f4070706-2a47-459e-b416-8f2424f499de tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_rules [ 795.148483] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_rules [ 795.148750] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.148884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.148936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.149759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.149861] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.275457] env[65381]: INFO networking_nsxv3.common.synchronization [None req-fabbefd9-36ba-499a-bf29-9435aed97daf tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_rules [ 795.275957] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_rules [ 795.276276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.276387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.673679] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.673679] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf already deleted. [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.673679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.673679] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.689025] env[65381]: INFO networking_nsxv3.common.synchronization [req-286762aa-dac6-47eb-801b-fe8dcb3af58c req-433a20d4-9a8e-4737-84d8-dc3ab909194f service nova] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_rules [ 795.689025] env[65381]: INFO networking_nsxv3.common.synchronization [req-286762aa-dac6-47eb-801b-fe8dcb3af58c req-433a20d4-9a8e-4737-84d8-dc3ab909194f service nova] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 795.689025] env[65381]: INFO networking_nsxv3.common.synchronization [req-286762aa-dac6-47eb-801b-fe8dcb3af58c req-433a20d4-9a8e-4737-84d8-dc3ab909194f service nova] Enqueued Resource ID: 5b895fc5-3925-41c3-9d3a-bcb409db9cb0 with Priority: HIGHEST for action port [ 795.689025] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_rules [ 795.689586] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 795.689840] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b895fc5-3925-41c3-9d3a-bcb409db9cb0 with Priority: HIGHEST for action port [ 795.690347] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.690619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.691376] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.691595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.691970] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.692225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.694018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.694018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.694018] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b895fc5-3925-41c3-9d3a-bcb409db9cb0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.173829] env[65381]: INFO networking_nsxv3.common.synchronization [None req-ba744a98-2d76-40ed-8fcc-1e3279eff066 None None] Enqueued Resource ID: f37d8283-2bf7-485c-8897-715f550bf73a with Priority: HIGHEST for action port [ 796.174374] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f37d8283-2bf7-485c-8897-715f550bf73a with Priority: HIGHEST for action port [ 796.174705] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f37d8283-2bf7-485c-8897-715f550bf73a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.174972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f37d8283-2bf7-485c-8897-715f550bf73a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.174972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f37d8283-2bf7-485c-8897-715f550bf73a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.175266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f37d8283-2bf7-485c-8897-715f550bf73a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.175348] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f37d8283-2bf7-485c-8897-715f550bf73a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.190282] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 796.190514] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 796.190575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.195684] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b895fc5-3925-41c3-9d3a-bcb409db9cb0 with status ACTIVE [ 796.195982] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.196114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.196114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.196316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.196404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.196587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.196692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.196759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.197071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.197071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.197222] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.197318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.197381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.197567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.197636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.197724] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b895fc5-3925-41c3-9d3a-bcb409db9cb0 is going to be updated. [ 796.200528] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.201259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.201259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.201259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.201259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.201259] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf already deleted. [ 796.201259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.226191] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.226362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.226406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.226594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.226735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.226934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b895fc5-3925-41c3-9d3a-bcb409db9cb0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.542577] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 796.542753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.543086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.543194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.543377] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.543627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.543627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.543773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.543838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.543903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.544034] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.545016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.545101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.545232] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.545415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.545415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.545525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.545599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.549025] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.679782] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f37d8283-2bf7-485c-8897-715f550bf73a [ 796.679834] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.679936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.680022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.680320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.680320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.680497] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f37d8283-2bf7-485c-8897-715f550bf73a already deleted. [ 796.680564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f37d8283-2bf7-485c-8897-715f550bf73a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.825987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 796.826578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.047989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.048220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.048436] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.552251] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.055475] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.055475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.055475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.055709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.055709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.055776] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 798.084530] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.084909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.085022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.085220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.085369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.095782] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 800.028283] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbfcc1b2-8767-4b56-bf42-46f1529ac3c7 req-7e50ba87-8fbc-4dc6-ac03-8690becf394c tempest-ListServerFiltersTestJSON-1861833264 tempest-ListServerFiltersTestJSON-1861833264-project-member] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 800.028692] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 800.028996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.029600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.108340] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 800.108532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.109350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.109573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.110309] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.110309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.110309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.110309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.110544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.110544] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.350951] env[65381]: INFO networking_nsxv3.common.synchronization [req-aee7aab3-7470-4e6f-aab6-2d42a187659d req-110f2449-216c-4b5a-a5d1-e0a705ba9458 tempest-VolumesAdminNegativeTest-1385301175 tempest-VolumesAdminNegativeTest-1385301175-project-member] Enqueued Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_members [ 800.350951] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGHEST for action security_group_members [ 800.351794] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.351946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.352024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.352269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.352513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.352680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.352680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.352875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.352993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.353105] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.463869] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.464130] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.464319] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.465172] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.465566] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.465886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.466127] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.466413] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.466606] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.466794] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 800.466902] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.467018] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.467171] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.467282] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 800.467321] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.467778] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.491460] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.491626] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 800.491756] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.491934] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-994" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.492294] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-3832e937-231d-4357-8833-bc0ba8accd8e taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.492525] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.492677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.492970] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.493129] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3832e937-231d-4357-8833-bc0ba8accd8e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.612778] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.855479] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.856538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.856538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.856662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.856696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.856997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.857154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.857383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.857454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.857532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.857634] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e500f09-f228-4346-a756-40b98d2928da is going to be updated. [ 800.888941] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.888941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.888941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.889150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.889275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.899232] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e500f09-f228-4346-a756-40b98d2928da in Status: IN_PROGRESS for 2s [ 800.995632] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.995852] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.995975] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.996276] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.996423] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.996575] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 3832e937-231d-4357-8833-bc0ba8accd8e not found, creating... [ 800.996854] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.997090] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.997090] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.997289] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.997414] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.997683] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.997830] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.997938] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.998147] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.998274] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.998405] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 3832e937-231d-4357-8833-bc0ba8accd8e is going to be created. [ 801.018198] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.018453] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.018539] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.018806] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.019076] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.019237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.114694] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.500022] env[65381]: INFO networking_nsxv3.common.synchronization [req-cb47ccff-bd2c-4e92-8a2f-74dc5c45c958 req-5186e884-117d-4677-b742-5740355dc953 tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 801.500022] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 801.500022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.500022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.500022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.500822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.501300] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.501548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.501703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.501987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.502197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.502376] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.620414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.620633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.620708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.621083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.621083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.621181] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 801.650843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.650843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.650843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.650843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.650843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.661866] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 801.735442] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbfcc1b2-8767-4b56-bf42-46f1529ac3c7 req-4e1dc316-c465-43e8-8979-34a94ee23de2 service nova] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_rules [ 801.735626] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbfcc1b2-8767-4b56-bf42-46f1529ac3c7 req-4e1dc316-c465-43e8-8979-34a94ee23de2 service nova] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 801.735754] env[65381]: INFO networking_nsxv3.common.synchronization [req-dbfcc1b2-8767-4b56-bf42-46f1529ac3c7 req-4e1dc316-c465-43e8-8979-34a94ee23de2 service nova] Enqueued Resource ID: 3832e937-231d-4357-8833-bc0ba8accd8e with Priority: HIGHEST for action port [ 801.736427] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_rules [ 801.736583] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 801.736681] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3832e937-231d-4357-8833-bc0ba8accd8e with Priority: HIGHEST for action port [ 801.736973] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.737517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.740614] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.740757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.741038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3832e937-231d-4357-8833-bc0ba8accd8e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.741160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.741258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.741581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.741718] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3832e937-231d-4357-8833-bc0ba8accd8e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.757915] env[65381]: INFO networking_nsxv3.common.synchronization [req-4acdb099-e8a1-42a7-a336-f89f78a4ef36 req-1a62032e-716e-401d-80f2-122d66268556 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 801.759668] env[65381]: INFO networking_nsxv3.common.synchronization [req-4acdb099-e8a1-42a7-a336-f89f78a4ef36 req-1a62032e-716e-401d-80f2-122d66268556 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 801.759668] env[65381]: INFO networking_nsxv3.common.synchronization [req-4acdb099-e8a1-42a7-a336-f89f78a4ef36 req-1a62032e-716e-401d-80f2-122d66268556 tempest-SecurityGroupsTestJSON-834288876 tempest-SecurityGroupsTestJSON-834288876-project-member] Enqueued Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_members [ 801.759668] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGHEST for action security_group_members [ 801.759668] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGHEST for action security_group_members [ 801.759668] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGHEST for action security_group_members [ 801.760925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.760925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.760925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.760925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.760925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.760925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.760925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.760925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.761262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.761262] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.762629] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.762629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.762629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.762887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.763103] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.763215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.763278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.763536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.764608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.764608] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.765515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-925daac4-0253-45dd-b73d-5ba84bd9c0d5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.765618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.766385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.766385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.766385] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.766608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.766608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.766675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.769702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.769702] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.005260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.005526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.005618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.005897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.005994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.006225] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.006353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.006419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.006599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.006713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.006847] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 802.038952] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.039110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.039178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.039393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.039532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.050477] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 802.249495] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3832e937-231d-4357-8833-bc0ba8accd8e with status ACTIVE [ 802.251357] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.251531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.251531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.251755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.251831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.252042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.252142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.252202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.252353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.252492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.252693] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.252802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.253221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.255252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.255252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.255252] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3832e937-231d-4357-8833-bc0ba8accd8e is going to be updated. [ 802.271234] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.271632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.271632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.273335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.273335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.273335] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.273335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.273335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.273335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.273335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.273335] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be updated. [ 802.275039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.275039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.275175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.275331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.275443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.275686] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.275842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.275926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.276150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.276251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.276390] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be updated. [ 802.282510] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.284234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.284326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.284523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.284632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.285764] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.285764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.285860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.285993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.286088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.286183] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 is going to be updated. [ 802.288928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.289069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.289138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.291384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.291384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.291384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3832e937-231d-4357-8833-bc0ba8accd8e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.329611] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.329611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.329770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.330760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.330760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.333634] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.333768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.333871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.336016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.336016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.336451] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.336586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.336661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.336814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.336938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.360104] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: IN_PROGRESS for 2s [ 802.361402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: IN_PROGRESS for 2s [ 802.362678] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: IN_PROGRESS for 2s [ 802.911864] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e500f09-f228-4346-a756-40b98d2928da in Status: SUCCESS [ 802.912092] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e500f09-f228-4346-a756-40b98d2928da deletion is rescheduled due to dependency. [ 802.912210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.672722] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 803.672722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.673035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.673109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.673310] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.673510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.673583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.673744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.673831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.673911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.674121] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.674208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.674269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.674367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.674509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.674598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.674670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.674963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.674963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.674963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.675116] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.675950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.676336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.676336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.676500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.676500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.676599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.676651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.676702] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.061105] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 804.061306] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 804.061418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.179253] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a824681a-154e-415a-8473-76ea98ebc45a: rpc.has_security_group_logging(os_id): False [ 804.180781] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.199038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.199985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.199985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.199985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.199985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.199985] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.199985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.199985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.200376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.200376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.200441] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.200537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.200580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.200726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.200796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.200971] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.201095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.201178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.201359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.201483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.201619] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be created. [ 804.262597] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.262748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.262827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.263042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.263228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.276748] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 804.375795] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 in Status: SUCCESS [ 804.376027] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 deletion is rescheduled due to dependency. [ 804.376107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.376903] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48eacb50-df32-446c-947a-a00fbf576caa in Status: SUCCESS [ 804.377049] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48eacb50-df32-446c-947a-a00fbf576caa deletion is rescheduled due to dependency. [ 804.377180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.377779] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 in Status: SUCCESS [ 804.379257] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 deletion is rescheduled due to dependency. [ 804.379418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.684039] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.188146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.188300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.188372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.188664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.188711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.188793] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 805.216949] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.217120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.217193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.217487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.217679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.228733] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 806.099407] env[65381]: INFO networking_nsxv3.common.synchronization [None req-cca3cd93-094b-486a-ad60-268f4ea88120 None None] Enqueued Resource ID: 8b9a24ce-586c-4520-b889-5c9ec6921d12 with Priority: HIGHEST for action port [ 806.099407] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b9a24ce-586c-4520-b889-5c9ec6921d12 with Priority: HIGHEST for action port [ 806.099407] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b9a24ce-586c-4520-b889-5c9ec6921d12 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.099407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b9a24ce-586c-4520-b889-5c9ec6921d12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.099407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b9a24ce-586c-4520-b889-5c9ec6921d12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.099748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b9a24ce-586c-4520-b889-5c9ec6921d12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.099748] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b9a24ce-586c-4520-b889-5c9ec6921d12',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.288943] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 806.289224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.289447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.289592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.289683] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.604169] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b9a24ce-586c-4520-b889-5c9ec6921d12 [ 806.604169] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.604169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.604169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.604169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.604169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.604169] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b9a24ce-586c-4520-b889-5c9ec6921d12 already deleted. [ 806.604169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b9a24ce-586c-4520-b889-5c9ec6921d12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.792169] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.792346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.239866] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 807.240175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.240286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.240808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.240808] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.241165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.241165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.241165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.241165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.241382] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.743868] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.246137] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.750672] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.750672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.750672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.750672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.750672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.750672] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 808.780773] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.780897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.780964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.781171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.781318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.791257] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 808.942371] env[65381]: INFO networking_nsxv3.common.synchronization [None req-de7f6096-1ded-4640-a5f3-fc34636bbc83 None None] Enqueued Resource ID: 8593a13e-d3d5-4f3b-8ea4-d016413a44bf with Priority: HIGHEST for action port [ 808.942916] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593a13e-d3d5-4f3b-8ea4-d016413a44bf with Priority: HIGHEST for action port [ 808.943227] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8593a13e-d3d5-4f3b-8ea4-d016413a44bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.943351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8593a13e-d3d5-4f3b-8ea4-d016413a44bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.943417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8593a13e-d3d5-4f3b-8ea4-d016413a44bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.943792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8593a13e-d3d5-4f3b-8ea4-d016413a44bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.943792] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8593a13e-d3d5-4f3b-8ea4-d016413a44bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.446120] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8593a13e-d3d5-4f3b-8ea4-d016413a44bf [ 809.446394] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.446506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.446859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.446859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.446980] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8593a13e-d3d5-4f3b-8ea4-d016413a44bf already deleted. [ 809.447043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8593a13e-d3d5-4f3b-8ea4-d016413a44bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.803553] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 810.803866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.803999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.804186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.804381] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.804518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.804670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.804737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.804800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.804994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.805095] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.307824] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.308055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.308109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.308683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.308683] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.308683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.308683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.308922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.308922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.308922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.309027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.309114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.309171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.309314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.309450] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.309541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.309594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.309729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.309802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.309882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.309970] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.812989] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a824681a-154e-415a-8473-76ea98ebc45a: rpc.has_security_group_logging(os_id): False [ 811.832070] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.832240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.832357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.832585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.832694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.832938] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.833092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.833147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.833312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.833417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.833631] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.833736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.833818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.833989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.835059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.835297] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.835435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.835540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.835618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.835693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.835801] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 811.901149] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.901387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.901387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.901682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.901758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.917026] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 813.935755] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 813.936088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.936350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.936650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.936799] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.943447] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 813.943616] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 814.440048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.440048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.440048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.440048] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.945029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.945029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.945029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.945029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.945029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.945971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.945971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.945971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.945971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.945971] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.450171] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a824681a-154e-415a-8473-76ea98ebc45a: rpc.has_security_group_logging(os_id): False [ 815.470546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.470700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.470843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.471137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.471235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.471466] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.471577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.471674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.471835] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.471915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.472477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.472607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.472679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.472884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.472993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.473211] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.473312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.473373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.473676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.473676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.473676] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 815.550770] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.550941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.550982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.551267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.551357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.564949] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 817.130191] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-ef189c3f-b7a8-4c95-b385-d946f32c5110 tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 817.130662] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 817.131553] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.131553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.131553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.131553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.131918] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.131918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.131918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.132130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.132130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.132227] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.470325] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.470577] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.470634] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.470882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.473868] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.473868] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.473868] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.473868] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.473868] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.473868] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.473868] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.473868] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.473868] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.473868] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.473868] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.473868] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.516210] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.516428] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.516570] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.516738] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.517101] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-7b54255d-8c01-4123-b250-b309627ce8fc taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.517418] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.517418] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.517764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.517925] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b54255d-8c01-4123-b250-b309627ce8fc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.597920] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 817.597920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.637819] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.637819] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.637819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.637819] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 817.671397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.671571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.671644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.671858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.672009] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.687042] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 818.021512] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.022382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.022382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.022382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.022382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.022661] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 7b54255d-8c01-4123-b250-b309627ce8fc not found, creating... [ 818.022835] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.023015] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.023134] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.023402] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.023481] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.023790] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.023973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.024146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.024365] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.024494] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.024628] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 7b54255d-8c01-4123-b250-b309627ce8fc is going to be created. [ 818.046585] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.046792] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.046925] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.047210] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.047430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.047645] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.723134] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-1e73c1af-f490-422b-bc84-041025d3114d service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 818.725389] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-1e73c1af-f490-422b-bc84-041025d3114d service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 818.725389] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-1e73c1af-f490-422b-bc84-041025d3114d service nova] Enqueued Resource ID: 7b54255d-8c01-4123-b250-b309627ce8fc with Priority: HIGHEST for action port [ 818.725612] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 818.725789] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 818.725859] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b54255d-8c01-4123-b250-b309627ce8fc with Priority: HIGHEST for action port [ 818.726175] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.726294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.726362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.726557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.726645] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.727956] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.728072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.728295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b54255d-8c01-4123-b250-b309627ce8fc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.728417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.728481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.729064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.729064] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b54255d-8c01-4123-b250-b309627ce8fc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.231783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.231928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.232137] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b54255d-8c01-4123-b250-b309627ce8fc with status ACTIVE [ 819.232332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.232727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.232727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.232863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.232863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.233035] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.233129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.233197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.233354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.233578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.233660] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.233725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.233813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.234065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.234212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.234403] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b54255d-8c01-4123-b250-b309627ce8fc is going to be updated. [ 819.262292] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.262483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.262577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.262873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.264042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.264042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b54255d-8c01-4123-b250-b309627ce8fc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.699542] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 4s [ 819.762028] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-4cadf4c8-6654-4a6a-81de-e744f1cff39d tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 819.763813] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 819.764220] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.764365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.128275] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-808 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.128275] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.128429] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.129028] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.129028] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.129028] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.129265] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.129315] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.130927] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.130927] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.130927] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.130927] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.130927] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.130927] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.130927] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.130927] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.150103] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.150287] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.150419] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.150625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-808" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.151014] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-8f21af62-7b7b-4aef-b88b-543c8bf501f0 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.151197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.151324] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.151637] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.151775] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f21af62-7b7b-4aef-b88b-543c8bf501f0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.655897] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.656161] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.656245] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.656514] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.656647] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.656792] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 8f21af62-7b7b-4aef-b88b-543c8bf501f0 not found, creating... [ 820.657063] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.657206] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.657339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.657536] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.657669] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.658016] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.658208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.658322] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.658544] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.658682] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.658825] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 8f21af62-7b7b-4aef-b88b-543c8bf501f0 is going to be created. [ 820.679932] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.680417] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.680710] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.681154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.681431] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.681700] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.384308] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-87307c2b-da98-4d26-a734-fa020f240d89 service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 821.384562] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-87307c2b-da98-4d26-a734-fa020f240d89 service nova] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 821.384750] env[65381]: INFO networking_nsxv3.common.synchronization [req-57f450e1-90ec-4999-a43b-eda9f9db68b4 req-87307c2b-da98-4d26-a734-fa020f240d89 service nova] Enqueued Resource ID: 8f21af62-7b7b-4aef-b88b-543c8bf501f0 with Priority: HIGHEST for action port [ 821.385277] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_rules [ 821.385417] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 821.385517] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f21af62-7b7b-4aef-b88b-543c8bf501f0 with Priority: HIGHEST for action port [ 821.386786] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.386786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.386786] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.387029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.387442] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f21af62-7b7b-4aef-b88b-543c8bf501f0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.387442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.387442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.387735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.387735] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f21af62-7b7b-4aef-b88b-543c8bf501f0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.710960] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 821.710960] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 deletion is rescheduled due to dependency. [ 821.710960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.711567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.711567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.712777] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.712777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.712777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.712777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.712777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.712777] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.890697] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f21af62-7b7b-4aef-b88b-543c8bf501f0 with status ACTIVE [ 821.890697] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.890856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.890856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.891107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.891210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.891404] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.891511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.891570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.891736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.891818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.891995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.892096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.892145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.892785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.892785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.892785] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f21af62-7b7b-4aef-b88b-543c8bf501f0 is going to be updated. [ 821.913650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.913800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.913872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.914128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.914271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.914455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f21af62-7b7b-4aef-b88b-543c8bf501f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.214669] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.498051] env[65381]: INFO networking_nsxv3.common.synchronization [req-e01a56ae-3e3e-484e-890d-c1b5e7d2e7d9 req-8c271700-7d4d-4973-be45-eb5b02b50103 tempest-ServersTestManualDisk-1163278782 tempest-ServersTestManualDisk-1163278782-project-member] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_members [ 822.499061] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_members [ 822.499445] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.499712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.499712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.500106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.500327] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.500512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.500651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.500909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.501063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.501213] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.717996] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.931108] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-284 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.931311] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-284" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.931429] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-284" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.931739] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-284" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.931989] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.932154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.932345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.932478] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.932643] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.932848] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.932951] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.933123] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.933235] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.933380] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.933435] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.933556] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.954781] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.955058] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.955166] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.955387] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-284" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.955699] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.955864] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.955971] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.956298] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.956428] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c007e8a3-f58e-4610-9480-dc3ff1dc0f46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.003833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.004036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.004086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.004285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.004374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.004574] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.004673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.004734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.004912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.004975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.005071] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 already deleted. [ 823.005149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221075] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.221075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.221075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.221319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.221368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221503] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 823.267667] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.267950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.267950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.268167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.268247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.280376] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 823.458409] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.458706] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.458852] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.459252] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.459416] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.459566] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port c007e8a3-f58e-4610-9480-dc3ff1dc0f46 not found, creating... [ 823.459826] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.459985] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.460093] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.460309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.460459] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.460736] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.460886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.461043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.461211] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.461334] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.461462] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: c007e8a3-f58e-4610-9480-dc3ff1dc0f46 is going to be created. [ 823.483970] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.484308] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.484476] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.484764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.485383] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.485383] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.608411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.608909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.608909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.609060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.609257] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.112541] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.581266] env[65381]: INFO networking_nsxv3.common.synchronization [req-e01a56ae-3e3e-484e-890d-c1b5e7d2e7d9 req-e6441c9d-1238-49a2-9bc8-feebbd84842d service nova] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_rules [ 824.581604] env[65381]: INFO networking_nsxv3.common.synchronization [req-e01a56ae-3e3e-484e-890d-c1b5e7d2e7d9 req-e6441c9d-1238-49a2-9bc8-feebbd84842d service nova] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_members [ 824.581604] env[65381]: INFO networking_nsxv3.common.synchronization [req-e01a56ae-3e3e-484e-890d-c1b5e7d2e7d9 req-e6441c9d-1238-49a2-9bc8-feebbd84842d service nova] Enqueued Resource ID: c007e8a3-f58e-4610-9480-dc3ff1dc0f46 with Priority: HIGHEST for action port [ 824.582099] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_rules [ 824.582260] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_members [ 824.582323] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007e8a3-f58e-4610-9480-dc3ff1dc0f46 with Priority: HIGHEST for action port [ 824.582633] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.582771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.582836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.583050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.583133] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.583997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.584120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.584219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.584347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.584500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.584782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.584782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.584850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.584891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.584999] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.585848] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.585966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.586067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.586223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.586297] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c007e8a3-f58e-4610-9480-dc3ff1dc0f46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.616534] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.845796] env[65381]: INFO networking_nsxv3.common.synchronization [req-18b521cc-0835-4e90-8488-dc458f87ab0f req-2211f9e9-9ce9-45ac-aa8d-79078ab124d1 tempest-ListImageFiltersTestJSON-1885631896 tempest-ListImageFiltersTestJSON-1885631896-project-member] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 824.846334] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGHEST for action security_group_members [ 824.846640] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.846764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.846832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.847283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.847513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.847661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.847729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.847906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.847994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.848102] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.952334] env[65381]: INFO networking_nsxv3.common.synchronization [req-290c26a9-eff8-4260-a948-2ec03efa9ac6 req-e4e7e8e7-e0cc-49d7-a405-99503437f66e tempest-ListServerFiltersTestJSON-1861833264 tempest-ListServerFiltersTestJSON-1861833264-project-member] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 824.952931] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 824.953393] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.953526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.953526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.953753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.953908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.954041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.954113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.954275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.954329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.954420] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.094109] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.094109] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.094109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.094109] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c007e8a3-f58e-4610-9480-dc3ff1dc0f46 with status ACTIVE [ 825.094109] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.094109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.094109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.094109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.095065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.095551] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.096264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.096496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.096786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.096972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.097271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.097485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.097625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.100018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.100018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.100018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c007e8a3-f58e-4610-9480-dc3ff1dc0f46 is going to be updated. [ 825.118817] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 825.118933] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 825.124239] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.124239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.124239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.124239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.124239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.124239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c007e8a3-f58e-4610-9480-dc3ff1dc0f46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.295134] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 825.295233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.299024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.299024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.299024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.299024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.299024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.350879] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.351045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.351195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.351334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.351422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.351676] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.351769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.351808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.351990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.352042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.352102] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be updated. [ 825.395531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.395531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.395531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.395531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.395531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.406796] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: IN_PROGRESS for 2s [ 825.458143] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.600484] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.800723] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.800723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.804819] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.961486] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.056654] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.056882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.056953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.057215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.070656] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 826.071652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.073309] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 826.106661] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.106912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.106997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.107281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.107378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.107722] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 is going to be created. [ 826.129252] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.129447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.129447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.129615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.135351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.136268] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 826.136416] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.136557] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 826.171246] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.171503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.171720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.171794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.172057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.183586] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 in Status: UNINITIALIZED for 2s [ 826.199552] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.199770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.199863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.200131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.201971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.202326] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 826.306364] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.335726] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.335925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.335982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.336340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.336435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.336639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 826.339968] env[65381]: INFO networking_nsxv3.common.synchronization [req-d90002e1-3470-4083-b893-3d93edec698d req-cd43ae4f-46bc-4532-a76f-4eecc59d4f4a tempest-ServerAddressesNegativeTestJSON-678078596 tempest-ServerAddressesNegativeTestJSON-678078596-project-member] Enqueued Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_members [ 826.341427] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_members [ 826.341427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.341427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.341427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.341427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.341630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.341686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.341729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.341924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.341987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.342044] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.428729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.428729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.428729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.428729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.428729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.428729] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 826.428729] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fb70f39c-753b-4f89-a31c-4120096fef6d', '49e6fdae-1268-4ea7-94d5-411cc41d7cad', '53de03fd-4fbd-4af6-8e63-64f644b84c00', '2e2dd58b-5e4b-4dc2-b012-9446a5a94987', '36c26613-3a87-42fa-8ca3-452389ee3bb3', 'c9c03ef0-b5e2-4757-9488-6558cc6e9841', 'a89d4d84-7cb2-4c08-be05-40a006a7aba6', '0b43997e-750b-4b84-8753-4d1519f37ae2', '9694af19-2e42-4299-8799-3ccc40da653d', '7e500f09-f228-4346-a756-40b98d2928da', '9fc522b2-0ead-4b7f-a221-ba7a88af5839', '34a23f96-505a-4b63-87f3-5175bacc51ab', '925daac4-0253-45dd-b73d-5ba84bd9c0d5', '5e525ee2-71eb-4b6c-8d4b-ec2247632bbc', '915a6b47-7bba-4851-9dc7-06e0692a5259', 'ca1b5748-90c1-473a-ab4f-767cc4ab05d7', '413b19eb-94ec-489a-b47a-feaf8a84da43', '6e0f1f6c-cf36-4109-b367-60396c3e8160', '0e917637-f523-43f9-9811-f2b68b364eb6', '92b18233-8c11-4b7d-91cb-3bc14d1e9183', 'a824681a-154e-415a-8473-76ea98ebc45a', 'ca937f1d-ad54-42e4-88d0-5a460de400c2', '1845664f-8bfa-4c5b-b1d8-5f3082db2137', '2380b72e-771a-447f-bf96-4a7738880121', '6413c0f9-b937-44ab-ae61-b7613757b3e9', '993d6955-5d35-45d8-9907-eba6ec8a9076', '8b58c566-5d76-43c3-8ec7-fbe48a220f7a', '2fa502cc-eee4-43e5-bf7a-e5551fb38a40', '40be60f5-b915-4038-8a92-b31ab9bbba3e', '0e6956fc-e986-4223-b0b3-c4fabc7eb8cf', '46372329-aee9-4feb-9469-adefbb727cb5', '51eca9de-71e7-42ac-8af4-13f26cb274bd', '274f904b-e458-4b4b-9611-3ae0669bc24b', '61c2d48d-c321-4e23-999d-809958401c70', '007dd7b5-b0ce-46da-9cc3-86f074d0bbdb', '48eacb50-df32-446c-947a-a00fbf576caa', '2f08ea40-f56b-4bd5-a0f9-e991cad65528', '6b334e63-c2b8-4d02-9110-c8fc60d33c13', 'bb17e366-3b38-46cd-836a-5d640fa33c5a', '0109d178-d310-4d94-9ce8-74560a55bfa3'} {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.428729] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 826.452360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.452360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.452360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.452539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.452677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.452799] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 826.452866] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.452934] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 826.466455] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.466455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.466455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.466455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.466641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.466641] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 826.504423] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.504565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.504684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.504845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.504985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.506897] env[65381]: INFO networking_nsxv3.common.synchronization [None req-dd88f4ae-db04-4031-b528-95935b7641f3 tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 4ab65720-743f-40ca-ab89-541195f33d87 with Priority: HIGHEST for action security_group_rules [ 826.507499] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ab65720-743f-40ca-ab89-541195f33d87 with Priority: HIGHEST for action security_group_rules [ 826.508177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ab65720-743f-40ca-ab89-541195f33d87 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.508300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.508353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.508581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.508657] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ab65720-743f-40ca-ab89-541195f33d87',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.519091] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 826.539553] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.539713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.539771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.540018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.540828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.542035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 826.542035] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.542035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 826.542035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 826.542035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGH for action security_group_rules [ 826.542035] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGH for action security_group_rules [ 826.542835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGH for action security_group_rules [ 826.543144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.727416] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e26f063b-f145-43c8-a8b2-e73274e01c3b tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 4ab65720-743f-40ca-ab89-541195f33d87 with Priority: HIGHEST for action security_group_rules [ 826.727416] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ab65720-743f-40ca-ab89-541195f33d87 with Priority: HIGHEST for action security_group_rules [ 826.727416] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGH for action security_group_rules [ 826.727416] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 with Priority: HIGH for action security_group_rules [ 826.727785] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 with Priority: HIGH for action security_group_rules [ 826.727785] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGH for action security_group_rules [ 826.727785] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 with Priority: HIGH for action security_group_rules [ 826.727879] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGH for action security_group_rules [ 826.727879] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 with Priority: HIGH for action security_group_rules [ 826.727994] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 with Priority: HIGH for action security_group_rules [ 826.728112] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGH for action security_group_rules [ 826.728245] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGH for action security_group_rules [ 826.728379] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 with Priority: HIGH for action security_group_rules [ 826.728530] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGH for action security_group_rules [ 826.728746] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 with Priority: HIGH for action security_group_rules [ 826.728909] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e500f09-f228-4346-a756-40b98d2928da with Priority: HIGH for action security_group_rules [ 826.730030] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGH for action security_group_rules [ 826.730030] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGH for action security_group_rules [ 826.730030] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 with Priority: HIGH for action security_group_rules [ 826.730030] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGH for action security_group_rules [ 826.730030] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad with Priority: HIGH for action security_group_rules [ 826.730351] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 with Priority: HIGH for action security_group_rules [ 826.730429] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ab65720-743f-40ca-ab89-541195f33d87 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.730533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.731142] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.731142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.731142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.731315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.731315] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.732199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53de03fd-4fbd-4af6-8e63-64f644b84c00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.732312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.732365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.732533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.732662] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53de03fd-4fbd-4af6-8e63-64f644b84c00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.734777] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.734777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.734777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.734962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.735029] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a89d4d84-7cb2-4c08-be05-40a006a7aba6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.736195] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.736331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.736396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.736518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.736602] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.737530] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.737640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.739065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.739065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.739065] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92b18233-8c11-4b7d-91cb-3bc14d1e9183',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.739065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.739800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.739891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.740085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.740133] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.744996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e0f1f6c-cf36-4109-b367-60396c3e8160 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.744996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.744996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.744996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.744996] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e0f1f6c-cf36-4109-b367-60396c3e8160',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.744996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-413b19eb-94ec-489a-b47a-feaf8a84da43 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.744996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.744996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.744996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.744996] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('413b19eb-94ec-489a-b47a-feaf8a84da43',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.747285] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.747613] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.747805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.748174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.750073] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.750073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.750073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.750073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.750073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.750073] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.751934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.752632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.754951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.754951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.754951] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('925daac4-0253-45dd-b73d-5ba84bd9c0d5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.754951] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.755606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.755834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.758034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.758034] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.758034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.758034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.758034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.758034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.758034] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fc522b2-0ead-4b7f-a221-ba7a88af5839',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.759148] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e500f09-f228-4346-a756-40b98d2928da taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.759223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.759280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.761033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.761033] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e500f09-f228-4346-a756-40b98d2928da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.761033] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.761033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.761033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.761033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.761033] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.762023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.762135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.762195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.762777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.762886] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.766215] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b43997e-750b-4b84-8753-4d1519f37ae2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.766215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.766215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.766215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.766215] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b43997e-750b-4b84-8753-4d1519f37ae2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.766215] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.766215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.766608] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.766608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.766608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.766739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.766739] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49e6fdae-1268-4ea7-94d5-411cc41d7cad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.767390] env[65381]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 826.768129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.768129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.768129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.768335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.768335] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e2dd58b-5e4b-4dc2-b012-9446a5a94987',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.773835] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.774079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.774079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.774344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.774529] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.774656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.774758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.774990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.775162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.775634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.775634] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.805266] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.805767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.805767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.805767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.809587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.809587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.809587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.809833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.809833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.809833] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 826.835545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.835716] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be deleted. [ 826.844641] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.844815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.844885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.845143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.845278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.845421] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.845779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.845779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.845779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.845903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.845953] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7edcc5-73dd-4323-8612-25595c2370aa already deleted. [ 826.846060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.848892] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.848998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.849081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.849275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.849429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.861032] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 826.862173] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.862361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.862482] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.862879] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.863199] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.863364] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.863497] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.863876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.865044] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.865307] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.865460] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.865554] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.865645] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.866255] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.866376] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.866511] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.890705] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.890705] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.890705] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.890705] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.891176] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.891375] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.892646] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.892930] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.893171] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('925b5b71-80e1-465a-bfe8-39b1fe58a3ed',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.906269] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.906414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.906485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.906687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.906791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.906929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.033825] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.034084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.034249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.034482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.034645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.034846] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ab65720-743f-40ca-ab89-541195f33d87 already deleted. [ 827.035008] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.035329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.035737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.035901] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ab65720-743f-40ca-ab89-541195f33d87',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.255439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.255657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.255657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.255904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.257612] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.257748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.258472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.258636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.270709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.270938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.271057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.271323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.271537] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.271681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.271756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.272058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.272191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.272312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.272435] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.278558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.278699] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53de03fd-4fbd-4af6-8e63-64f644b84c00 is going to be deleted. [ 827.279798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.280026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.281013] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.293447] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.293719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.303946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.304256] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92b18233-8c11-4b7d-91cb-3bc14d1e9183 is going to be deleted. [ 827.306150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.306414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.315937] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.316153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.316291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.316493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.316687] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.316825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.316932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.317130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.317249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.317363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.317476] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.322325] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.322325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.322325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.322325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.322555] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.322680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.322779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.323042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.323642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.323960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.324132] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.325318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.325318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.325575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.325813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.326078] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.326221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.326294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.327504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.327504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.327504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.327504] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.338073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.338270] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a89d4d84-7cb2-4c08-be05-40a006a7aba6 is going to be deleted. [ 827.340230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.340346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.340463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.340744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.378836] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.378999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.384271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.384386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.385643] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.385768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.399101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.399101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.399487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.399606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.400072] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.400243] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.400472] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.400807] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.401978] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.401978] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 925b5b71-80e1-465a-bfe8-39b1fe58a3ed not found, creating... [ 827.401978] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.401978] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.401978] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.402304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.402304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.402523] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.402759] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.402877] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.403108] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.403292] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.403431] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 925b5b71-80e1-465a-bfe8-39b1fe58a3ed is going to be created. [ 827.405354] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.405527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.406281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.406373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.407304] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.407304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.407925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.408148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.409831] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.409831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.425868] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46372329-aee9-4feb-9469-adefbb727cb5 in Status: SUCCESS [ 827.425868] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 deletion is rescheduled due to dependency. [ 827.425868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.434864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.434864] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49e6fdae-1268-4ea7-94d5-411cc41d7cad is going to be deleted. [ 827.434864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.434864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.477703] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.477940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.478064] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.478344] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.478574] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.478805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.481701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.481810] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e0f1f6c-cf36-4109-b367-60396c3e8160 is going to be deleted. [ 827.482885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.483141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.492957] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.493215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.549474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.549474] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b43997e-750b-4b84-8753-4d1519f37ae2 is going to be deleted. [ 827.550855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.551184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.551313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.551543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53de03fd-4fbd-4af6-8e63-64f644b84c00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.551663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.551876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.551998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.552181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92b18233-8c11-4b7d-91cb-3bc14d1e9183" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.552832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.553148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.594119] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.594346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.622406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.622553] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 925daac4-0253-45dd-b73d-5ba84bd9c0d5 is going to be deleted. [ 827.623731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.624020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.654292] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.654513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.661433] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.661648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.686588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.686588] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e500f09-f228-4346-a756-40b98d2928da is going to be deleted. [ 827.687451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.687658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.776183] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.784960] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915a6b47-7bba-4851-9dc7-06e0692a5259: rpc.has_security_group_logging(os_id): False [ 827.801022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.801235] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fc522b2-0ead-4b7f-a221-ba7a88af5839 is going to be deleted. [ 827.802305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.802543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.804679] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.804848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.820926] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.821280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.836212] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.836473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.836590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.836860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.837241] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.837381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.837472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.837697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.837828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.837967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.838214] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.838353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.838440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.838638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.838832] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.838966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.839087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.839268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.839398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.839514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.839650] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.843172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.843172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.843172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.843172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.843172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.843554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.843554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.843554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.843701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.843749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.843926] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.844066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.844155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.844353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.844546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.844682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.844776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.844985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.845100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.845216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.845342] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.846724] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.011456] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.011638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.012509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.012688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.025301] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 828.025985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.026496] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be deleted. [ 828.027430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.027717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.066418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.067119] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e2dd58b-5e4b-4dc2-b012-9446a5a94987 is going to be deleted. [ 828.068190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.068281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.116969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.117149] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be deleted. [ 828.118285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.118444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.172706] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 413b19eb-94ec-489a-b47a-feaf8a84da43 is going to be deleted. [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a89d4d84-7cb2-4c08-be05-40a006a7aba6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.172706] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ab65720-743f-40ca-ab89-541195f33d87 already deleted. [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ab65720-743f-40ca-ab89-541195f33d87" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.172706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.173463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e0f1f6c-cf36-4109-b367-60396c3e8160" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.173463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.173463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.173463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.173463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49e6fdae-1268-4ea7-94d5-411cc41d7cad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.173463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.173711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.173711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b43997e-750b-4b84-8753-4d1519f37ae2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-925daac4-0253-45dd-b73d-5ba84bd9c0d5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.174550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.203290] env[65381]: INFO networking_nsxv3.common.synchronization [req-d90002e1-3470-4083-b893-3d93edec698d req-65c37b4c-de83-489a-b48a-80ff3a3e1b21 service nova] Enqueued Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_rules [ 828.203483] env[65381]: INFO networking_nsxv3.common.synchronization [req-d90002e1-3470-4083-b893-3d93edec698d req-65c37b4c-de83-489a-b48a-80ff3a3e1b21 service nova] Enqueued Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_members [ 828.203654] env[65381]: INFO networking_nsxv3.common.synchronization [req-d90002e1-3470-4083-b893-3d93edec698d req-65c37b4c-de83-489a-b48a-80ff3a3e1b21 service nova] Enqueued Resource ID: 925b5b71-80e1-465a-bfe8-39b1fe58a3ed with Priority: HIGHEST for action port [ 828.204235] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_rules [ 828.204378] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_members [ 828.204488] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925b5b71-80e1-465a-bfe8-39b1fe58a3ed with Priority: HIGHEST for action port [ 828.204791] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.204940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.204973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.205689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.205689] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.206559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.206681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.206760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.207096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.207264] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.207366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.207428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.207590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.207686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.207789] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.208915] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.209051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.209134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.209298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.209386] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('925b5b71-80e1-465a-bfe8-39b1fe58a3ed',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.214966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.215270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.216916] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 in Status: SUCCESS [ 828.217104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.217271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.217552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.217766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.217914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.218044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.218166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.218240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.218346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.218460] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.220312] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.220445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.224639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.224999] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.225117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.225194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.225411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.225511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.225607] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 828.226798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.227017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.227824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.227955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e500f09-f228-4346-a756-40b98d2928da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.229619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.229883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.229961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.230185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fc522b2-0ead-4b7f-a221-ba7a88af5839" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.230376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.230547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.230625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.230737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.269741] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.269928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.269928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.270163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.270287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.270452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e2dd58b-5e4b-4dc2-b012-9446a5a94987" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.278513] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb70f39c-753b-4f89-a31c-4120096fef6d: rpc.has_security_group_logging(os_id): False [ 828.300702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.300933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.301027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.301284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.303628] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.303931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.346950] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc: rpc.has_security_group_logging(os_id): False [ 828.348121] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca1b5748-90c1-473a-ab4f-767cc4ab05d7: rpc.has_security_group_logging(os_id): False [ 828.349391] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9694af19-2e42-4299-8799-3ccc40da653d: rpc.has_security_group_logging(os_id): False [ 828.418401] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.418545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.425493] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.425785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.433889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.433889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.433889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.434289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.434709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.434804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.452985] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 828.453580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.453905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.454052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.454119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.454314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.454474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.454517] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d is going to be updated. [ 828.456036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.456303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.456501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.456701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.456928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.457270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.457430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.457640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-413b19eb-94ec-489a-b47a-feaf8a84da43" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.457883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.458149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.458373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.459781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.460172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.503181] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 828.515941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.516054] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.516160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.516230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.516445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.516535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.516642] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 828.518126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.518339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.523560] env[65381]: INFO networking_nsxv3.common.synchronization [req-ddd784e1-6633-4767-a914-2c71afa25b49 req-e699a923-1963-4c7a-bb17-fc29e2a6a846 tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 828.524668] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 828.525044] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.525182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.525240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.525452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.525633] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.526303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.526303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.526303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.526303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.526454] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.551352] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 828.552059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.578701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.579072] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.579197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.579262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.579477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.579560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.579762] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.579863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.579995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.580134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.580206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.580398] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.580477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.580530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.580670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.580746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.580828] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be updated. [ 828.582124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.582303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.637564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.639373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.639373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.639373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.639878] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.639878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.639878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.639878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.639878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.640063] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 828.651767] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.651891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.651976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.652394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.652506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.655155] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.655331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.655400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.655640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.655792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.673279] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: IN_PROGRESS for 2s [ 828.674223] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 828.705593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.705676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.705731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.706124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.706372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.714877] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.716131] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.716254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.716416] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 925b5b71-80e1-465a-bfe8-39b1fe58a3ed with status ACTIVE [ 828.716576] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.716687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.716739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.716967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.717084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.717310] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.717455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.717593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.717849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.717953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.718215] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.718321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.718386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.718542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.718620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.718712] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 925b5b71-80e1-465a-bfe8-39b1fe58a3ed is going to be updated. [ 828.723556] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.756481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.756680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.756771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.757017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.757204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.762722] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 828.791833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.792077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.792149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.792352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.792523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.792791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-925b5b71-80e1-465a-bfe8-39b1fe58a3ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.801547] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 828.881830] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 828.882221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.882526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.882861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.883112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.883262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.883331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.883501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.883586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.883689] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.029411] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.104123] env[65381]: INFO networking_nsxv3.common.synchronization [req-8a63f917-6db9-46e4-a657-b3590344f329 req-ac7c45b9-2cb2-4cee-92a0-3a2c6205b67b tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_members [ 829.104849] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_members [ 829.108236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.108236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.108236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.108236] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.220589] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.228473] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4bef8d2-2573-40a3-9fa1-478fba08e217: rpc.has_security_group_logging(os_id): False [ 829.251413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.251413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.251413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.251413] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 is going to be created. [ 829.328773] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.328929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.329303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.329571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.329764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.342427] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 in Status: IN_PROGRESS for 2s [ 829.387950] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.448261] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.448519] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.448592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.449080] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.449632] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.449632] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.449632] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.449796] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.449796] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.449976] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.450095] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.450196] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.450294] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.451065] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.451065] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.451065] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.484706] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.484895] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.485043] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.485227] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.485549] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-3ef495be-d49b-451d-be21-c54ca4b9c936 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.485724] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.485843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.486280] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.486432] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef495be-d49b-451d-be21-c54ca4b9c936',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.531846] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.612073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.612073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.612073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.612073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.612073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.612283] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.612462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.612462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.612581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.612645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.612743] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 already deleted. [ 829.612827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.730918] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.730918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.730918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.731329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.731329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.731329] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7edcc5-73dd-4323-8612-25595c2370aa is going to be created. [ 829.762319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.763088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.763088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.763088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.763088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.774704] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: UNINITIALIZED for 2s [ 829.889106] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.989181] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.989511] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.989693] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.990149] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.990372] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.990639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 3ef495be-d49b-451d-be21-c54ca4b9c936 not found, creating... [ 829.991050] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.991297] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.991480] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.991898] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.992140] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.992668] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.992894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.993095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.993423] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.993649] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.994214] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 3ef495be-d49b-451d-be21-c54ca4b9c936 is going to be created. [ 830.017644] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.017977] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.018151] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.018465] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.018753] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.019067] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.034050] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.034266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.034368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.034623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.034719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.034821] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 830.078477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.078668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.078714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.078904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.079090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.099189] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 830.392567] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.392827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.392879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.393143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.393244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.393373] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 830.426615] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.426835] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.426881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.427176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.427380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.438356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 830.526056] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 830.526237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.692156] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 830.692505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.693187] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: SUCCESS [ 830.693363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.700583] env[65381]: INFO networking_nsxv3.common.synchronization [req-8a63f917-6db9-46e4-a657-b3590344f329 req-db6277b9-d5e5-4a58-978b-25fbdb084d7d service nova] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_rules [ 830.700583] env[65381]: INFO networking_nsxv3.common.synchronization [req-8a63f917-6db9-46e4-a657-b3590344f329 req-db6277b9-d5e5-4a58-978b-25fbdb084d7d service nova] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_members [ 830.700583] env[65381]: INFO networking_nsxv3.common.synchronization [req-8a63f917-6db9-46e4-a657-b3590344f329 req-db6277b9-d5e5-4a58-978b-25fbdb084d7d service nova] Enqueued Resource ID: 3ef495be-d49b-451d-be21-c54ca4b9c936 with Priority: HIGHEST for action port [ 830.700583] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_rules [ 830.700914] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_members [ 830.700914] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ef495be-d49b-451d-be21-c54ca4b9c936 with Priority: HIGHEST for action port [ 830.701355] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.701486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.701554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.701751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.701835] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.702750] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.702896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.702975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.705457] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.705457] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.705457] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ef495be-d49b-451d-be21-c54ca4b9c936 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.705457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.705457] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ef495be-d49b-451d-be21-c54ca4b9c936',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.789938] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 830.790290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.826666] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 830.826898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.207210] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.208372] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.208597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.208652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ef495be-d49b-451d-be21-c54ca4b9c936 with status ACTIVE [ 831.209308] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.209501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.211245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.211245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.211245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.211245] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ef495be-d49b-451d-be21-c54ca4b9c936 is going to be updated. [ 831.236468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.236674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.236750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.237548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.237776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.237948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ef495be-d49b-451d-be21-c54ca4b9c936" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.354795] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 in Status: SUCCESS [ 831.355055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.659141] env[65381]: INFO networking_nsxv3.common.synchronization [req-cf3910b1-35de-4e2b-94b3-0d13c2096560 req-ca0a20eb-8536-4f4b-9f8e-4cae33d328d1 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 831.659690] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 831.660017] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.660873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.660949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.661302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.661414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.661952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.661952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.665103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.665231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.665351] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.713841] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.786819] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: SUCCESS [ 831.787386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.787847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.788155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.788484] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.788729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.788909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.789119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.789211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.789305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.789399] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.037919] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.037919] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.037919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.037919] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.037919] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.037919] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.037919] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.038494] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.038494] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.038494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.060845] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.061130] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.061907] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.062112] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.062431] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-14c4e822-ca10-44cb-90df-cfb2999e36e2 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.062606] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.062754] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.063348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.063348] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c4e822-ca10-44cb-90df-cfb2999e36e2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.110069] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 832.110300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.167419] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.167621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.167659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.167865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.167965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.168196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.168301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.168366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.168569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.168656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.168805] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be deleted. [ 832.208014] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.208358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.208358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.208443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.208588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.208628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.216994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.217163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.217233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.217453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.217596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.217638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 is going to be created. [ 832.241774] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.241980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.241980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.242199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.242369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.254566] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 in Status: UNINITIALIZED for 2s [ 832.292327] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.292497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.292571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.292852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.293040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.293156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.293273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.293360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.293445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.293564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.293734] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.293832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.293886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.294044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.294189] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.294355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.294355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.294494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.294581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.294635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.294771] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.452015] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 832.452249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.452428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.452690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.452875] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.452999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.453086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.453231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.453313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.453400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.453559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.453840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.453946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.454090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.454230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.454317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.454395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.454511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.454582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.454664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.454754] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.566745] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.567019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.567198] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.567461] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.567609] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.567767] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 14c4e822-ca10-44cb-90df-cfb2999e36e2 not found, creating... [ 832.568123] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.568321] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.568413] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.568650] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.568789] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.569092] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.569255] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.569372] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.569585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.569719] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.569864] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 14c4e822-ca10-44cb-90df-cfb2999e36e2 is going to be created. [ 832.590602] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.590855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.590965] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.591286] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.591549] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.591801] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.798574] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f7edcc5-73dd-4323-8612-25595c2370aa: rpc.has_security_group_logging(os_id): False [ 832.827361] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.827586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.827586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.827815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.827941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.828153] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.828234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.828273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.828428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.828522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.828710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.828829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.828910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.829142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.829208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.829411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.829510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.829574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.829726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.829807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.829899] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f7edcc5-73dd-4323-8612-25595c2370aa is going to be created. [ 832.924534] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.924832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.924832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.925077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.925300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.939193] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: IN_PROGRESS for 2s [ 832.956919] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36c26613-3a87-42fa-8ca3-452389ee3bb3: rpc.has_security_group_logging(os_id): False [ 832.976714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.976894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.976894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.977014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.008752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.008752] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.009181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.009181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.009181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.009293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.009420] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.009525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.009588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.009745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.009820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.009995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.010105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.010166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.010307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.010383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.010468] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 833.127049] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.127270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.127367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.127641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.127842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.151420] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 833.329814] env[65381]: INFO networking_nsxv3.common.synchronization [req-cf3910b1-35de-4e2b-94b3-0d13c2096560 req-25a75c1a-eaf6-4f31-b312-2988906e67c2 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 833.330119] env[65381]: INFO networking_nsxv3.common.synchronization [req-cf3910b1-35de-4e2b-94b3-0d13c2096560 req-25a75c1a-eaf6-4f31-b312-2988906e67c2 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 833.330289] env[65381]: INFO networking_nsxv3.common.synchronization [req-cf3910b1-35de-4e2b-94b3-0d13c2096560 req-25a75c1a-eaf6-4f31-b312-2988906e67c2 service nova] Enqueued Resource ID: 14c4e822-ca10-44cb-90df-cfb2999e36e2 with Priority: HIGHEST for action port [ 833.331075] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 833.331254] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 833.331383] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c4e822-ca10-44cb-90df-cfb2999e36e2 with Priority: HIGHEST for action port [ 833.331770] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.331976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.332695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.334654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.334808] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.336118] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.336989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.336989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.337193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.337441] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.337594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.337799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.337934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.338084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.338274] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.339442] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-14c4e822-ca10-44cb-90df-cfb2999e36e2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.341582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.341582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.341582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.341582] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c4e822-ca10-44cb-90df-cfb2999e36e2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.842559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.842767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.843053] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.844751] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14c4e822-ca10-44cb-90df-cfb2999e36e2 with status ACTIVE [ 833.846483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.846483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.846483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.846483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.847569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.847569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.847569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.847569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.847569] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14c4e822-ca10-44cb-90df-cfb2999e36e2 is going to be updated. [ 833.875038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.875329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.875329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.875467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.875538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.875663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14c4e822-ca10-44cb-90df-cfb2999e36e2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.006172] env[65381]: INFO networking_nsxv3.common.synchronization [req-fe9591e2-8dac-425c-b8aa-038703a5719c req-13f1c3b4-09b8-4e2c-b72c-bb2d1eca2f9a tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 834.006786] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 834.007342] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.007505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.007616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.007878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.008095] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.008346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.008466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.008718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.008843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.008952] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.147507] env[65381]: INFO networking_nsxv3.common.synchronization [req-d9fe608d-7f3d-4bb0-a5e6-1542c83f14b4 req-414b8553-e653-45c8-ab06-034ab22c93ed tempest-MultipleCreateTestJSON-1610253628 tempest-MultipleCreateTestJSON-1610253628-project-member] Enqueued Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 834.147507] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 with Priority: HIGHEST for action security_group_members [ 834.147507] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-36c26613-3a87-42fa-8ca3-452389ee3bb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.148387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.266227] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 in Status: SUCCESS [ 834.266761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.267111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.267486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.267855] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.268230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.268422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.268748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.268953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.269170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.269391] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.345180] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.464869] env[65381]: INFO networking_nsxv3.common.synchronization [req-6446e565-3b98-48ec-a934-4279a42cb5f1 req-d8ff8de5-b494-438e-b71d-28b7b0cfca19 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 834.465579] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 834.465924] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.466133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.466417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.466515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.466644] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.466756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.466808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.467162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.467162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.467162] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.517829] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.772729] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.847854] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.847854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.847854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.848263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.848456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.848746] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be created. [ 834.883104] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.883268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.883330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.883556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.883752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.900417] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: UNINITIALIZED for 2s [ 834.948599] env[65381]: INFO networking_nsxv3.common.synchronization [req-6dd7ade1-7afb-495c-a204-a53c23f21d21 req-d0c7e4ef-5bac-4b57-821d-c7f824c74235 tempest-ServersAdminNegativeTestJSON-218141663 tempest-ServersAdminNegativeTestJSON-218141663-project-member] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 834.949162] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGHEST for action security_group_members [ 834.949656] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.949794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.949863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.950443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.950696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.950817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.950883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.951082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.951202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.951258] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.953630] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: SUCCESS [ 834.953857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.969047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.969182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.969251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.969840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.977495] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.977682] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.977799] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.978087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.978893] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.979084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.979234] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.979428] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.979572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.979806] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.979924] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.980705] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.980705] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.980705] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.980705] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.980705] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.996780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.997053] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.997173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.997237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.997432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.997507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.997593] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 835.007085] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.007554] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 835.007554] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.007703] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.007909] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-00176d63-72f7-4149-982e-59e6d284243c taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.008190] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.008309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.008664] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.008781] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00176d63-72f7-4149-982e-59e6d284243c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.024412] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.026680] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.026880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.026930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.027187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.027331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.037928] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 835.169119] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 835.169560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.169911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.170295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.170754] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.276581] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5deaafa-85eb-41da-90a6-8945218fb5f5: rpc.has_security_group_logging(os_id): False [ 835.297715] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.297924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.297924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.298179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.298287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.298588] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.298666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.298666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.298824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.298899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.298984] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 is going to be created. [ 835.373846] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.374260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.374381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.374669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.374948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.397435] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 in Status: IN_PROGRESS for 2s [ 835.455009] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.455189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.455262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.455491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.455585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.455989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.455989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.455989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.456183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.456183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.456246] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be updated. [ 835.491113] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.491346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.491434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.491685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.491797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.501644] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: IN_PROGRESS for 2s [ 835.511388] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.511681] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.511854] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.512249] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.513135] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.513135] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 00176d63-72f7-4149-982e-59e6d284243c not found, creating... [ 835.513135] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.513382] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.513586] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.513932] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.514200] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.514629] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.515431] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.515801] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.516173] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.516473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.516832] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 00176d63-72f7-4149-982e-59e6d284243c is going to be created. [ 835.526710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.527111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.527111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.527411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.527569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.527719] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be updated. [ 835.550643] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.551404] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.551404] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.551546] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.551873] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.552808] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.563299] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.563432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.563507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.563702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.563835] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.575076] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: IN_PROGRESS for 2s [ 835.703807] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.703995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.704060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.704280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.704368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.704503] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be deleted. [ 835.800052] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.800052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.800052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.800052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.800245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.800245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.800984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.803081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.803081] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.257442] env[65381]: INFO networking_nsxv3.common.synchronization [req-6446e565-3b98-48ec-a934-4279a42cb5f1 req-47113ba9-1619-4590-824d-a5aae4e78bc8 service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 836.257442] env[65381]: INFO networking_nsxv3.common.synchronization [req-6446e565-3b98-48ec-a934-4279a42cb5f1 req-47113ba9-1619-4590-824d-a5aae4e78bc8 service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 836.257583] env[65381]: INFO networking_nsxv3.common.synchronization [req-6446e565-3b98-48ec-a934-4279a42cb5f1 req-47113ba9-1619-4590-824d-a5aae4e78bc8 service nova] Enqueued Resource ID: 00176d63-72f7-4149-982e-59e6d284243c with Priority: HIGHEST for action port [ 836.257846] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 836.257973] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 836.258085] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00176d63-72f7-4149-982e-59e6d284243c with Priority: HIGHEST for action port [ 836.258652] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.258787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.258883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.259212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.259258] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.260111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.260202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.260394] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-00176d63-72f7-4149-982e-59e6d284243c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.260497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.260597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.260854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.260954] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00176d63-72f7-4149-982e-59e6d284243c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.324256] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.324256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.324256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.324256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.324256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.324256] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 already deleted. [ 836.324256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.764051] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.764362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.764406] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00176d63-72f7-4149-982e-59e6d284243c with status ACTIVE [ 836.764571] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.764677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.764742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.764971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.765107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.765550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.765550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.765550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.765706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.765706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.765909] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.765975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.766024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.766171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.766345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.766345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00176d63-72f7-4149-982e-59e6d284243c is going to be updated. [ 836.793277] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.793493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.793493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.794351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.794351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.794351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00176d63-72f7-4149-982e-59e6d284243c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.909595] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 836.909842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.910434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.910705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.910841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.910958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.911034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.911190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.911273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.911352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.911477] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.050203] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 837.050203] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 837.050203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.050822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.050822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.050822] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.050822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.051102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.051102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.051102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.051252] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.414017] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 in Status: SUCCESS [ 837.414341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.414525] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.414671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.414753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.415038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.415253] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.415383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.415485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.415742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.415812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.415923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.419544] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.419690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.419759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.419961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.420352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.420352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.420352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.420512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.420547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.420650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.420765] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.513153] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc in Status: SUCCESS [ 837.513473] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc deletion is rescheduled due to dependency. [ 837.513652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.554324] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.586645] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 in Status: SUCCESS [ 837.586910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.587379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.587379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.587582] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.587681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.587750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.587908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.588017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.588114] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36c26613-3a87-42fa-8ca3-452389ee3bb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.923913] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a23f96-505a-4b63-87f3-5175bacc51ab: rpc.has_security_group_logging(os_id): False [ 837.944086] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.944397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.944397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.944579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.944641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.944925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.945354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.945354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.945354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.945526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.945890] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.945890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.945890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.946654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.946782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.947047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.947189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.947275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.947450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.947556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.947723] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be created. [ 838.021064] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.021267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.021338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.021559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.021741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.038762] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 838.057786] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.094066] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.094276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.094410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.094543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.094834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.094834] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.095062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.095062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.095142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.095235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.095299] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36c26613-3a87-42fa-8ca3-452389ee3bb3 is going to be deleted. [ 838.123685] env[65381]: INFO networking_nsxv3.common.synchronization [req-004cd6d9-7d95-43b4-8eca-d50b01989171 req-0b4da53e-4e8b-47d7-997e-482acfee1f6d tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_members [ 838.124714] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_members [ 838.125026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.125180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.125922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.125922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.125922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.125922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.125922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.126208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.126208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.126208] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.133567] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.133798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.133798] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.134357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.134357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.134357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36c26613-3a87-42fa-8ca3-452389ee3bb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.483601] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.484090] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.484324] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.484807] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.485183] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.485517] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.485689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.487778] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.487778] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.487778] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.487778] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.487778] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.487778] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.487778] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.487778] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.487778] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.520613] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.520813] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.520926] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.521115] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.521456] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-0c53f323-49c5-4a62-863c-7961e3c1cdec taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.521635] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.521748] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.522095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.522235] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c53f323-49c5-4a62-863c-7961e3c1cdec',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.560728] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.560728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.561341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.561341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.561341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.561341] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 838.596274] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.597204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.597204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.597204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.597204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.607972] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 838.630483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.630609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.630695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.630902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.631725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.631725] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.631725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.631725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.631725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.631725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.631969] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf already deleted. [ 838.631969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.026541] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.026541] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.027043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.027043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.027261] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.027457] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 0c53f323-49c5-4a62-863c-7961e3c1cdec not found, creating... [ 839.027860] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.028089] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.028252] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.028652] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.028816] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.029325] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.029560] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.029734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.030059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.030300] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.030518] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 0c53f323-49c5-4a62-863c-7961e3c1cdec is going to be created. [ 839.059738] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.060052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.060052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.060266] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.060506] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.060741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.728656] env[65381]: INFO networking_nsxv3.common.synchronization [req-004cd6d9-7d95-43b4-8eca-d50b01989171 req-13c2b856-b8f2-4d21-b4ce-6406b54a5bb9 service nova] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_rules [ 839.728825] env[65381]: INFO networking_nsxv3.common.synchronization [req-004cd6d9-7d95-43b4-8eca-d50b01989171 req-13c2b856-b8f2-4d21-b4ce-6406b54a5bb9 service nova] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_members [ 839.728960] env[65381]: INFO networking_nsxv3.common.synchronization [req-004cd6d9-7d95-43b4-8eca-d50b01989171 req-13c2b856-b8f2-4d21-b4ce-6406b54a5bb9 service nova] Enqueued Resource ID: 0c53f323-49c5-4a62-863c-7961e3c1cdec with Priority: HIGHEST for action port [ 839.729182] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_rules [ 839.729306] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_members [ 839.729400] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c53f323-49c5-4a62-863c-7961e3c1cdec with Priority: HIGHEST for action port [ 839.730095] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.730223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.730292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.730541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.730593] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.731677] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.731801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.731857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.732029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.732183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.732326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.732381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.732468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.732558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.732649] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.733556] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c53f323-49c5-4a62-863c-7961e3c1cdec taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.733556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.733728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.733778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.733862] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c53f323-49c5-4a62-863c-7961e3c1cdec',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.063093] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 840.063890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.236342] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.237463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.237598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.237936] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c53f323-49c5-4a62-863c-7961e3c1cdec with status ACTIVE [ 840.238106] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.238211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.238274] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.238476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.238555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.238714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.238856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.238911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.239113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.239190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.240838] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.240838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.240838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.240838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.240838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.240838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c53f323-49c5-4a62-863c-7961e3c1cdec is going to be updated. [ 840.263393] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.263590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.263638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.264363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.264363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.264363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c53f323-49c5-4a62-863c-7961e3c1cdec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.622086] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 840.622086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.627112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.627112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.627112] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.706041] env[65381]: INFO networking_nsxv3.common.synchronization [req-154c1c02-9ae2-4f1a-8356-d0767d796660 req-2e7836ba-703e-486d-9cde-544bb72f299a tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 840.706041] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 840.706041] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.706041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.706041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.706041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.706403] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.706403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.706577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.706728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.706838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.706959] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.738910] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.125884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.126283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.126283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.126375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.126497] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.126602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.126667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.126823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.126910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.127009] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.127169] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.127265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.127329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.127475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.127760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.127858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.127942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.128130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.128211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.128298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.128389] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.209668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.209903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.209903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.210142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.210300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.210435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.210532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.210599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.210755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.210887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.210984] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be deleted. [ 841.242298] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.242455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.242556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.242830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.243591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.243591] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf is going to be created. [ 841.244829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.244983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.245115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.245222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.245353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.245450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.272146] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.272146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.272146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.272631] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.273169] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.273660] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.274059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.274440] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.274719] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.276258] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.276258] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.276258] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.276258] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.276258] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.276258] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.276258] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.279196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.279196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.279196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.279338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.279551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.300853] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf in Status: UNINITIALIZED for 2s [ 841.313210] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.313210] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.313210] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.313210] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.313210] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-e6c936ae-8be0-444f-bd10-b95e0581b81c taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.313210] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.313210] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.313210] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.313210] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6c936ae-8be0-444f-bd10-b95e0581b81c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.630858] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f08ea40-f56b-4bd5-a0f9-e991cad65528: rpc.has_security_group_logging(os_id): False [ 841.649884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.650148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.650277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.650553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.650717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.651013] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.651198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.651308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.651564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.651706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.652091] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.652298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.652357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.653264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.653420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.653716] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.653857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.653973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.654212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.654339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.654477] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 841.719050] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.719208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.719389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.719509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.719632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.733104] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 841.816687] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.817080] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.817211] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.817445] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.817637] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.817842] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port e6c936ae-8be0-444f-bd10-b95e0581b81c not found, creating... [ 841.818174] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.818378] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.818498] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.818774] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.818956] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.819297] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.819496] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.819612] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.819879] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.820052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.820225] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: e6c936ae-8be0-444f-bd10-b95e0581b81c is going to be created. [ 841.861894] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.861894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.861894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.862223] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.863050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.863050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.571466] env[65381]: INFO networking_nsxv3.common.synchronization [req-154c1c02-9ae2-4f1a-8356-d0767d796660 req-7edff052-cf1f-4c3d-9e93-e47e01ef7349 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 842.571466] env[65381]: INFO networking_nsxv3.common.synchronization [req-154c1c02-9ae2-4f1a-8356-d0767d796660 req-7edff052-cf1f-4c3d-9e93-e47e01ef7349 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 842.571466] env[65381]: INFO networking_nsxv3.common.synchronization [req-154c1c02-9ae2-4f1a-8356-d0767d796660 req-7edff052-cf1f-4c3d-9e93-e47e01ef7349 service nova] Enqueued Resource ID: e6c936ae-8be0-444f-bd10-b95e0581b81c with Priority: HIGHEST for action port [ 842.571466] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 842.571466] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 842.571466] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c936ae-8be0-444f-bd10-b95e0581b81c with Priority: HIGHEST for action port [ 842.571975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.571975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.571975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.572377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.572377] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.573810] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.573999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.574102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.574339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.574711] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.574711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.574963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.575241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.576056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.576056] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.576430] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6c936ae-8be0-444f-bd10-b95e0581b81c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.576558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.576558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.576691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.576766] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6c936ae-8be0-444f-bd10-b95e0581b81c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.079655] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.079655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.079655] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.080603] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6c936ae-8be0-444f-bd10-b95e0581b81c with status ACTIVE [ 843.081014] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.081014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.081014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.081250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.081696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.081696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.081696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.081696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.081864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.081864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.082338] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.083623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.083623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.083623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.083623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.083623] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6c936ae-8be0-444f-bd10-b95e0581b81c is going to be updated. [ 843.114262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.114425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.114497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.114718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.114855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.115147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6c936ae-8be0-444f-bd10-b95e0581b81c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.312014] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf in Status: SUCCESS [ 843.312014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.312014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.312313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.314017] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.314017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.314017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.314017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.314017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.314017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.314017] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.586706] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.650583] env[65381]: INFO networking_nsxv3.common.synchronization [req-f4ae539c-109f-48b5-9cf6-b587d882e7cc req-9b958b10-0763-41a5-9244-2dd79b32db4f tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 843.651196] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 843.651724] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.651816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.651863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.652216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.652344] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.654623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.654716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.654930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.654986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.655113] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.748287] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 843.748546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.817345] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.090263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.090263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.090263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.090263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.090263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.090263] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be created. [ 844.116467] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.116671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.116671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.116878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.117050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.129643] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: UNINITIALIZED for 2s [ 844.157984] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.158160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.158229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.158464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.158527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.158754] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.159113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.159113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.159113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.159113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.159289] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c already deleted. [ 844.159331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.169319] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.169493] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-927" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.169589] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-927" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.169912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-927" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.171294] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.171294] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.171294] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.171294] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.171294] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.171294] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.171294] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.171294] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.171294] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.171697] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.171697] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.171774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.192654] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.192824] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.192947] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.193139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-927" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.193453] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-ff1e5512-297e-46e9-a2ae-6efde73ca36f taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.193624] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.193743] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.194075] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.194215] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1e5512-297e-46e9-a2ae-6efde73ca36f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.320097] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf: rpc.has_security_group_logging(os_id): False [ 844.338281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.338487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.338631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.338866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.338958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.339250] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.339431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.339488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.339645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.339750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.339870] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf is going to be created. [ 844.396469] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.396675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.396749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.396959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.397160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.412555] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf in Status: IN_PROGRESS for 2s [ 844.699265] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.699694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.699694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.699950] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.700142] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.700220] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port ff1e5512-297e-46e9-a2ae-6efde73ca36f not found, creating... [ 844.700495] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.700674] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.700802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.701077] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.701280] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.701526] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.701685] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.701804] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.703199] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.703482] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.703662] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f is going to be created. [ 844.734787] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.734787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.734787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.734787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.734787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.734787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.472429] env[65381]: INFO networking_nsxv3.common.synchronization [req-f4ae539c-109f-48b5-9cf6-b587d882e7cc req-64a28df8-6402-405b-9a55-af3b878c21bf service nova] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_rules [ 845.472626] env[65381]: INFO networking_nsxv3.common.synchronization [req-f4ae539c-109f-48b5-9cf6-b587d882e7cc req-64a28df8-6402-405b-9a55-af3b878c21bf service nova] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 845.472761] env[65381]: INFO networking_nsxv3.common.synchronization [req-f4ae539c-109f-48b5-9cf6-b587d882e7cc req-64a28df8-6402-405b-9a55-af3b878c21bf service nova] Enqueued Resource ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f with Priority: HIGHEST for action port [ 845.473359] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_rules [ 845.473583] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 845.473835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f with Priority: HIGHEST for action port [ 845.474233] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.474481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.474624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.474979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.475093] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.476206] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.476206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.476368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.476479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.476656] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.476777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.476891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.477012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.477112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.477241] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.481410] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1e5512-297e-46e9-a2ae-6efde73ca36f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.481569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.481680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.481936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.482052] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1e5512-297e-46e9-a2ae-6efde73ca36f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.985022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.985022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.985022] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.986768] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff1e5512-297e-46e9-a2ae-6efde73ca36f with status ACTIVE [ 845.986768] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.986768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.986768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.986768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.987027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.987527] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.987769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.987769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.987976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.987976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.988204] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.988327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.988424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.988667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.988797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.988836] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f is going to be updated. [ 846.013893] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.013893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.013893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.014260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.014323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.014489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.140402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 846.140627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.140803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.141041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.141239] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.141355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.141435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.141573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.141645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.141734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.141827] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.155950] env[65381]: INFO networking_nsxv3.common.synchronization [req-16cc28d1-4772-498a-b3b2-a09186f5898e req-7ea479ac-0ce0-403c-b86f-20158eea10fd tempest-ServerAddressesNegativeTestJSON-678078596 tempest-ServerAddressesNegativeTestJSON-678078596-project-member] Enqueued Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_members [ 846.156562] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGHEST for action security_group_members [ 846.157274] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.157424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.157547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.157769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.157976] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.158134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.158226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.158403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.158519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.158642] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.427125] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf in Status: SUCCESS [ 846.427125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.493269] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.647025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.647025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.647025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.647025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.647025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.647720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.647720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.647720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.647720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.647720] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.661450] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.661625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.661677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.662367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.662477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.662721] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.662880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.662975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.663177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.663242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.663330] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7edcc5-73dd-4323-8612-25595c2370aa is going to be updated. [ 846.697027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.697173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.697679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.697679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.697679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.708964] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: IN_PROGRESS for 2s [ 846.908831] env[65381]: INFO networking_nsxv3.common.synchronization [None req-56f01ffc-5bf4-45ad-97b6-a80dc8cbb9ef None None] Enqueued Resource ID: 8d3e3d08-b0a9-4502-be30-bc34d61576f0 with Priority: HIGHEST for action port [ 846.910380] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d3e3d08-b0a9-4502-be30-bc34d61576f0 with Priority: HIGHEST for action port [ 846.910974] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d3e3d08-b0a9-4502-be30-bc34d61576f0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.911141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d3e3d08-b0a9-4502-be30-bc34d61576f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.911593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d3e3d08-b0a9-4502-be30-bc34d61576f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.911663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d3e3d08-b0a9-4502-be30-bc34d61576f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.911940] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d3e3d08-b0a9-4502-be30-bc34d61576f0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.996942] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.997410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.997410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.997410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.997712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.997712] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be created. [ 847.022535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.022743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.022843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.023063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.023231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.036080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: UNINITIALIZED for 2s [ 847.152186] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9c03ef0-b5e2-4757-9488-6558cc6e9841: rpc.has_security_group_logging(os_id): False [ 847.172537] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.172537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.172537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.172537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.172537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.172537] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.172537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.172537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.175108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.175108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.175108] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.175108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.175108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.175108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.178030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.178030] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.178030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.178030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.178030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.178030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.178030] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be created. [ 847.242059] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.242314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.242314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.242770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.242770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.258035] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 847.413836] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d3e3d08-b0a9-4502-be30-bc34d61576f0 [ 847.414248] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.414455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.414560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.414837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.414973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.415244] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d3e3d08-b0a9-4502-be30-bc34d61576f0 already deleted. [ 847.415543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d3e3d08-b0a9-4502-be30-bc34d61576f0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.723710] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: IN_PROGRESS for 4s [ 849.049808] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 849.050113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.050326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.051048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.051048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.051048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.051449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.051449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.051449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.051643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.051643] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.276507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 849.276807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.554546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.554699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.554742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.554963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.555148] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.555304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.555358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.555955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.555955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.555955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.555955] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.555955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.555955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.556279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.556397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.556483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.556483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.559828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.559828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.559828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.559828] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.888641] env[65381]: INFO networking_nsxv3.common.synchronization [None req-77187084-30ea-4168-9813-47c4e200b1f2 None None] Enqueued Resource ID: 8e09de79-5d30-46c4-a2c4-ff4858783739 with Priority: HIGHEST for action port [ 849.888641] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e09de79-5d30-46c4-a2c4-ff4858783739 with Priority: HIGHEST for action port [ 849.888641] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e09de79-5d30-46c4-a2c4-ff4858783739 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.889029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e09de79-5d30-46c4-a2c4-ff4858783739" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.889029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e09de79-5d30-46c4-a2c4-ff4858783739" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.889189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e09de79-5d30-46c4-a2c4-ff4858783739" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.889301] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e09de79-5d30-46c4-a2c4-ff4858783739',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.054821] env[65381]: INFO networking_nsxv3.common.synchronization [req-f92b21db-7bca-46a2-be27-c5d1044d9c55 req-dc1ebfa7-bdc5-406d-81d4-3989766ea414 tempest-ListServerFiltersTestJSON-1861833264 tempest-ListServerFiltersTestJSON-1861833264-project-member] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 850.055433] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 850.055691] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.055816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.056746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.056746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.056746] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.056746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.056746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.056746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.056746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.056746] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.059174] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b719086a-b3a4-4011-8dd1-fa5d6f2d797c: rpc.has_security_group_logging(os_id): False [ 850.083523] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.083523] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.083523] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.083523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.084245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.084245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.084245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.084245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.084245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.084245] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be created. [ 850.161688] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.161848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.161957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.162228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.162421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.184438] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 850.391803] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e09de79-5d30-46c4-a2c4-ff4858783739 [ 850.392263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.392263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.392431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.392869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.393063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.393314] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e09de79-5d30-46c4-a2c4-ff4858783739 already deleted. [ 850.393440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e09de79-5d30-46c4-a2c4-ff4858783739" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.559448] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.740048] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f7edcc5-73dd-4323-8612-25595c2370aa in Status: SUCCESS [ 850.740218] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f7edcc5-73dd-4323-8612-25595c2370aa deletion is rescheduled due to dependency. [ 850.740332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.061866] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.566511] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.566716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.566716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.566915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.566979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.567745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 851.592249] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 412 Client Error: Precondition Failed for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/groups/a824681a-154e-415a-8473-76ea98ebc45a [ 851.592370] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 851.674081] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.674081] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.674081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.674081] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 851.707486] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.707629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.707697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.707933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.708107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.722197] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 852.197983] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 852.198316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.595580] env[65381]: INFO networking_nsxv3.common.synchronization [None req-051268c7-8f01-43b4-a6aa-67b7252bf059 None None] Enqueued Resource ID: 91d3ef16-b371-4d63-a002-28c21b839886 with Priority: HIGHEST for action port [ 853.596700] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d3ef16-b371-4d63-a002-28c21b839886 with Priority: HIGHEST for action port [ 853.596700] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-91d3ef16-b371-4d63-a002-28c21b839886 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.596700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91d3ef16-b371-4d63-a002-28c21b839886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.596700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91d3ef16-b371-4d63-a002-28c21b839886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.596700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91d3ef16-b371-4d63-a002-28c21b839886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.596700] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91d3ef16-b371-4d63-a002-28c21b839886',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.742677] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 853.742677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.100653] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91d3ef16-b371-4d63-a002-28c21b839886 [ 854.101085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.101271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.101338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.101574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.101664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.101769] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91d3ef16-b371-4d63-a002-28c21b839886 already deleted. [ 854.101855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91d3ef16-b371-4d63-a002-28c21b839886" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.053276] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-68a0c279-4c41-4bac-99ed-39621069eaac tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 855.053276] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 855.053276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.053276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.053276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.053276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.053276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.053917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.054129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.054393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.054591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.054790] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.406348] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-ac3fe4af-ffad-439d-97bd-1c2598282b39 tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 855.407514] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 855.407514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.407514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.559606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.559606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.559606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.560859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.560859] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be deleted. [ 855.595156] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.595156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.595347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.595392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.595519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.595639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.595809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.595998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.596502] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.596943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.596943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.596943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.596943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.600675] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.606167] env[65381]: INFO networking_nsxv3.common.synchronization [req-6b6448d4-fee1-4833-ac13-880f76b85943 req-eb63dd3c-2485-48e1-a07a-0572c5a7de89 tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 855.606727] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 855.606811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.606935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.606993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.607323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.607462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.607566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.607629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.607796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.607889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.607991] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.655081] env[65381]: INFO networking_nsxv3.common.synchronization [None req-8cf81e21-3b9f-47cb-8d3e-99d2c1a67cc2 None None] Enqueued Resource ID: 2761eb66-01af-4583-a944-970a2e3ea09e with Priority: HIGHEST for action port [ 855.655796] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2761eb66-01af-4583-a944-970a2e3ea09e with Priority: HIGHEST for action port [ 855.657639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-2761eb66-01af-4583-a944-970a2e3ea09e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.657639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2761eb66-01af-4583-a944-970a2e3ea09e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.657639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2761eb66-01af-4583-a944-970a2e3ea09e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.657639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2761eb66-01af-4583-a944-970a2e3ea09e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.657639] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2761eb66-01af-4583-a944-970a2e3ea09e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.907805] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.910492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-550" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.910492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-550" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.910689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-550" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.911036] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.911363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.911601] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.911989] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.915453] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.915674] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.915812] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.915959] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.916045] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.916201] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.916271] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.916421] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.937885] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.941640] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.941640] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.941640] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-550" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.941640] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-d3bc5185-a85b-415f-8d11-9c4987f439c6 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.941640] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.941640] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.941640] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.941640] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3bc5185-a85b-415f-8d11-9c4987f439c6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.103346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.103686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.103686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.103943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.104037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.104274] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.104383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.104445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.104657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.104719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.104791] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 already deleted. [ 856.104873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.111468] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.159786] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2761eb66-01af-4583-a944-970a2e3ea09e [ 856.160032] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.160169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.160247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.160445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.160536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.160629] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2761eb66-01af-4583-a944-970a2e3ea09e already deleted. [ 856.160729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2761eb66-01af-4583-a944-970a2e3ea09e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.447343] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.447343] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port d3bc5185-a85b-415f-8d11-9c4987f439c6 not found, creating... [ 856.447343] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.447343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.448135] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.448135] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.448135] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.449251] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.449979] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.449979] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: d3bc5185-a85b-415f-8d11-9c4987f439c6 is going to be created. [ 856.473545] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.474061] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.474255] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.474702] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.474966] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.475516] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.617296] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.119610] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.119975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.119975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.120158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.120228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.120326] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 857.155390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.155580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.155628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.155891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.156221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.167891] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 857.236529] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-f04bc515-ddc4-498f-a26d-2d32f5528517 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 857.236730] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-f04bc515-ddc4-498f-a26d-2d32f5528517 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 857.236818] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-f04bc515-ddc4-498f-a26d-2d32f5528517 service nova] Enqueued Resource ID: d3bc5185-a85b-415f-8d11-9c4987f439c6 with Priority: HIGHEST for action port [ 857.237525] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 857.237650] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 857.237778] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3bc5185-a85b-415f-8d11-9c4987f439c6 with Priority: HIGHEST for action port [ 857.238120] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.238391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.238461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.238704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.238784] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.240183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.240278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.240351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.241484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.241670] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.241840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.241885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.242392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.242392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.242596] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.244226] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3bc5185-a85b-415f-8d11-9c4987f439c6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.244226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.244226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.244542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.244542] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3bc5185-a85b-415f-8d11-9c4987f439c6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.749675] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3bc5185-a85b-415f-8d11-9c4987f439c6 with status ACTIVE [ 857.749675] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.749675] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.749675] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.749675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.750357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.750357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.750357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.750357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3bc5185-a85b-415f-8d11-9c4987f439c6 is going to be updated. [ 857.751529] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.752973] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.752973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786269] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.786269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.786269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.786269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.786269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3bc5185-a85b-415f-8d11-9c4987f439c6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.948734] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1f142749-2ccd-45f9-9af6-727fe10880f9 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_rules [ 857.949396] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_rules [ 857.949701] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.949838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.949906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.950626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.951202] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.090203] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.090407] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-791" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.090521] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-791" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.090876] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-791" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.091150] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.091384] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.091517] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.091747] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.091886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.092187] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.092297] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.092401] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.092538] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.092624] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.092721] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.092912] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.108944] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c8c9963a-0872-46fb-8327-169989f28c33 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_rules [ 858.109479] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_rules [ 858.110260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.110361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.119125] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.119298] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.119436] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.119606] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-791" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.119986] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-631a1cb4-e24a-402a-9c5c-144b715a46ac taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.120348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.120348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.120640] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.120780] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('631a1cb4-e24a-402a-9c5c-144b715a46ac',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.255598] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.474152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.474415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.474415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.474584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.474706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.474758] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c already deleted. [ 858.474857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.475015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.475208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.475293] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.624204] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.624204] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.624450] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.624540] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.624670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.624821] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 631a1cb4-e24a-402a-9c5c-144b715a46ac not found, creating... [ 858.625090] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.625279] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.625398] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.625621] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.625753] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.626047] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.626205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.626346] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.626630] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.626835] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.627031] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 631a1cb4-e24a-402a-9c5c-144b715a46ac is going to be created. [ 858.670307] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.670307] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.670436] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.670731] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.670997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.671886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.758326] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.758490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.758563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.758776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.758861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.758962] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be created. [ 858.798959] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.799156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.799219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.799421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.799616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.817735] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: UNINITIALIZED for 2s [ 859.000434] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.000607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.000663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.001041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.001187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.001305] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c already deleted. [ 859.001399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.178028] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 859.178353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.360279] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-e414ae10-8e55-499e-a66f-5587eac10a39 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 859.360279] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-e414ae10-8e55-499e-a66f-5587eac10a39 service nova] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 859.360392] env[65381]: INFO networking_nsxv3.common.synchronization [req-399d022a-3071-45e5-bcfb-150720cc02d7 req-e414ae10-8e55-499e-a66f-5587eac10a39 service nova] Enqueued Resource ID: 631a1cb4-e24a-402a-9c5c-144b715a46ac with Priority: HIGHEST for action port [ 859.360968] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_rules [ 859.361130] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 859.361231] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 631a1cb4-e24a-402a-9c5c-144b715a46ac with Priority: HIGHEST for action port [ 859.361541] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.361652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.361877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.361962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.362167] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-631a1cb4-e24a-402a-9c5c-144b715a46ac taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.362263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.362326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.362811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.362811] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('631a1cb4-e24a-402a-9c5c-144b715a46ac',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.864437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 631a1cb4-e24a-402a-9c5c-144b715a46ac with status ACTIVE [ 859.864695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.864925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.864925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.865149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.865332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.865476] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.865556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.865670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.865939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.865939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.866230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.866230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.866406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.866406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.866541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.866541] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 631a1cb4-e24a-402a-9c5c-144b715a46ac is going to be updated. [ 859.893982] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.894153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.894244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.894538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.894656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.894812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-631a1cb4-e24a-402a-9c5c-144b715a46ac" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.220521] env[65381]: INFO networking_nsxv3.common.synchronization [req-d0207648-273b-478a-804b-fc26bb5fbd87 req-61e3ec70-9d46-4048-98d9-c245d1dcdf81 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 860.220521] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 860.220908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.221037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.221148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.221348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.221509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.221615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.221703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.221843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.221906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.222027] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.724652] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.724862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.724862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.725135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.725264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.725591] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.725591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.725591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.725863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.725863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.725939] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 860.758627] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.758788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.758864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.759136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.759468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.790412] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 860.836356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 860.836653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.836893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.837182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.837418] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.837603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.837665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.837876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.837991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.838200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.838345] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.840745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.841096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.841314] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.841441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.841517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.841701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.841795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.841913] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.037260] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6b298c2-e630-40ea-988f-44f3951d5fc7 req-57ac9ead-f39b-47e2-b671-da6bfa727d00 tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 861.042076] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 861.042076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.042076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.042076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.042076] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.344767] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.344767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.349377] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.435477] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.435774] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.435958] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.436419] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.437562] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.437562] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.437562] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.437847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.437893] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.438236] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.438416] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.438599] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.438783] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.438998] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.439166] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.439382] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.459027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.459027] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 861.459027] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.459288] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.459545] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-63f81a3e-4f22-4e08-9167-f7138ff12ceb taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.459706] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.459823] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.460141] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.460390] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f81a3e-4f22-4e08-9167-f7138ff12ceb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.544600] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.545025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.545171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.545949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.579461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.579786] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.579923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.579997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.580278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.580433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.580573] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 861.611864] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.612198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.612316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.612559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.612723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.626402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 861.853405] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.962801] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.963237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.963450] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.963799] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.964057] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.964234] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 63f81a3e-4f22-4e08-9167-f7138ff12ceb not found, creating... [ 861.964515] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.964745] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.964937] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.969233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.969233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.969233] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.969233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.969233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.969233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.969233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.969233] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 63f81a3e-4f22-4e08-9167-f7138ff12ceb is going to be created. [ 861.989647] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.989870] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.990087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.990335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.990577] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.990806] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.359067] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.359067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.359067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.359067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.359067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.359067] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 862.392409] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.392409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.392409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.392409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.392634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.404296] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 862.490354] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 862.490533] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_members [ 862.491301] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 862.491301] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_members [ 862.491518] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.492129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.492129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.492129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.492293] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.492387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.492488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.492651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.492736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.492831] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.494181] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c46c4fd4-f6a3-4856-81c4-94599308df17 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.494303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.494348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.494625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.494776] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.494878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.494943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.495099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.495180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.495284] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.543842] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_rules [ 862.544220] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 862.545236] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_rules [ 862.545476] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_members [ 862.545680] env[65381]: INFO networking_nsxv3.common.synchronization [req-520c300c-78ea-46e3-9461-1ce7639eeac8 req-5071da7d-e447-46aa-890b-acaf8ea90cce tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f with Priority: HIGHEST for action port [ 862.546310] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_rules [ 862.546534] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_rules [ 862.546610] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f with Priority: HIGHEST for action port [ 862.546786] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 862.546932] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_members [ 862.547213] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.547379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.547475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.547718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.547910] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.549020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c46c4fd4-f6a3-4856-81c4-94599308df17 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.549020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.549186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.549450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.549450] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.550377] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1e5512-297e-46e9-a2ae-6efde73ca36f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.550535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.550639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.550879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.550948] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1e5512-297e-46e9-a2ae-6efde73ca36f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.552117] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.552235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.552532] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c46c4fd4-f6a3-4856-81c4-94599308df17 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.552631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.760747] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6b298c2-e630-40ea-988f-44f3951d5fc7 req-61b6c662-c8fa-4ef3-8a1e-fc94ba67f2ab service nova] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_rules [ 862.761235] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6b298c2-e630-40ea-988f-44f3951d5fc7 req-61b6c662-c8fa-4ef3-8a1e-fc94ba67f2ab service nova] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 862.762653] env[65381]: INFO networking_nsxv3.common.synchronization [req-c6b298c2-e630-40ea-988f-44f3951d5fc7 req-61b6c662-c8fa-4ef3-8a1e-fc94ba67f2ab service nova] Enqueued Resource ID: 63f81a3e-4f22-4e08-9167-f7138ff12ceb with Priority: HIGHEST for action port [ 862.762653] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_rules [ 862.762929] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 862.763179] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63f81a3e-4f22-4e08-9167-f7138ff12ceb with Priority: HIGHEST for action port [ 862.764046] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.764612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.764612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.764612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.764612] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.766027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.766123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.767088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-63f81a3e-4f22-4e08-9167-f7138ff12ceb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.767088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.767088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.767088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.767088] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f81a3e-4f22-4e08-9167-f7138ff12ceb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.801162] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 862.801162] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 862.801365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.997329] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.998563] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.054236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c46c4fd4-f6a3-4856-81c4-94599308df17 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.054429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.054634] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.054716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.054913] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff1e5512-297e-46e9-a2ae-6efde73ca36f with status ACTIVE [ 863.055577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.055704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.055771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.055980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.056079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.056284] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.056482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.056482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.056615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.056665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.056814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.056906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.056968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.057146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.057231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.057309] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f is going to be updated. [ 863.081737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.084556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.084659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.084900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.085075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.085267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.269496] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.269679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.269878] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63f81a3e-4f22-4e08-9167-f7138ff12ceb with status ACTIVE [ 863.270050] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.270155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.270224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.274023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.274023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.274023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.274023] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63f81a3e-4f22-4e08-9167-f7138ff12ceb is going to be updated. [ 863.301655] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.301655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.301655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.301655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.301655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.301655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63f81a3e-4f22-4e08-9167-f7138ff12ceb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.358123] env[65381]: INFO networking_nsxv3.common.synchronization [req-4e161b34-0649-4788-ab3c-94971947dff1 req-02e7ba8d-1cc5-4e3f-ba9e-c0a48d583ab9 tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 863.358123] env[65381]: INFO networking_nsxv3.common.synchronization [req-4e161b34-0649-4788-ab3c-94971947dff1 req-02e7ba8d-1cc5-4e3f-ba9e-c0a48d583ab9 tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_members [ 863.358979] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 863.359650] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46c4fd4-f6a3-4856-81c4-94599308df17 with Priority: HIGHEST for action security_group_members [ 863.362223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.362223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.362223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c46c4fd4-f6a3-4856-81c4-94599308df17 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.362223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.414948] env[65381]: INFO networking_nsxv3.common.synchronization [req-4e161b34-0649-4788-ab3c-94971947dff1 req-02e7ba8d-1cc5-4e3f-ba9e-c0a48d583ab9 tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_rules [ 863.415597] env[65381]: INFO networking_nsxv3.common.synchronization [req-4e161b34-0649-4788-ab3c-94971947dff1 req-02e7ba8d-1cc5-4e3f-ba9e-c0a48d583ab9 tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 863.415712] env[65381]: INFO networking_nsxv3.common.synchronization [req-4e161b34-0649-4788-ab3c-94971947dff1 req-02e7ba8d-1cc5-4e3f-ba9e-c0a48d583ab9 tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f with Priority: HIGHEST for action port [ 863.416451] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_rules [ 863.416871] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 863.416871] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f with Priority: HIGHEST for action port [ 863.417376] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.417376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.417566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.417669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.417881] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1e5512-297e-46e9-a2ae-6efde73ca36f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.418032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.418101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.418355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.418443] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1e5512-297e-46e9-a2ae-6efde73ca36f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.500066] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.501125] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.641630] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 863.641754] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb deletion is rescheduled due to dependency. [ 863.641925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.642249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.643278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.643278] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.643278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.643278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.643278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.643502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.643849] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.922083] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff1e5512-297e-46e9-a2ae-6efde73ca36f with status ACTIVE [ 863.922690] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.922690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.922947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.923062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.923216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.924256] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.924256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.924256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.924256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.924256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.924459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.924765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.924765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.924843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.924943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.925505] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff1e5512-297e-46e9-a2ae-6efde73ca36f is going to be updated. [ 863.950176] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.950176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.950176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.950369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.950398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.951346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1e5512-297e-46e9-a2ae-6efde73ca36f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.004263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.004421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.004501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.004736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.004827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.004928] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be updated. [ 864.006885] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.006885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.006885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.007068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.007158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.007251] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 is going to be created. [ 864.045816] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.045816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.046018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.046229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.049034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.051209] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.051328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.051328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.052941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.052941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.064886] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c46c4fd4-f6a3-4856-81c4-94599308df17 in Status: UNINITIALIZED for 2s [ 864.065307] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 864.148013] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.418160] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 864.418575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.418575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.418775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.418969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.419527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.419597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.419776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.419998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.420151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.420355] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.420548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.420620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.420810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.420960] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.421082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.421145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.421315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.421396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.421568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.421568] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.652643] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.925604] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e917637-f523-43f9-9811-f2b68b364eb6: rpc.has_security_group_logging(os_id): False [ 864.950933] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.951128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.951219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.951498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.951598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.951837] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.951958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.952031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.952174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.952256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.952504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.952627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.952690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.952843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.952954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.953328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.953482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.953575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.953766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.953870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.953993] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be created. [ 865.023414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.023702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.023702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.024113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.024400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.042200] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 865.154966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.155184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.155237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.155432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.155520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.155626] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 865.205023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.205023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.205023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.205023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.205023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.214928] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 866.086712] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 866.087079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.087256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.087509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.087737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.087868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.087922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.088100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.088207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.088308] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.093448] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c46c4fd4-f6a3-4856-81c4-94599308df17 in Status: SUCCESS [ 866.093700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.094144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.094280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.094566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.094707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.094773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.094956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.095816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.095881] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.593013] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.602995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.603173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.603257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.603435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.604053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.604053] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.604053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.604053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.604246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.604246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.604246] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 is going to be deleted. [ 866.647157] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.647157] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.647157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.647157] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.063857] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 867.063857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.063857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.065800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.065928] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.096139] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.149128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.149356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.149398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.149739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.149821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.150106] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.150266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.150359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.150549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.150628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.151604] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 already deleted. [ 867.151604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.151604] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.151823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.152026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.153085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.153819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.153902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.154084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.154192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.154299] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.228492] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 867.228492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.228492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.228805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.229120] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.229272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.229343] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.229536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.229630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.229731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.229822] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.567969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.568214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.568354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.568662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.568913] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.569206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.569313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.569605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.573811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.573811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.573969] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.601066] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.601066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.601066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.601066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.601245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.601345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be updated. [ 867.651106] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.655187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.655187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.655187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.655187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.658020] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c46c4fd4-f6a3-4856-81c4-94599308df17',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.660626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.660815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.660815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.661088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.661183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.661376] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.661514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.661574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.661716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.661833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.661899] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 already deleted. [ 867.661973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.667975] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 867.733445] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.733646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.733708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.733981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.734092] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.734214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.734264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.734409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.734494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.734583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.734735] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.734827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.734886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.735039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.735190] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.735307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.735361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.735510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.735584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.735668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.735762] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.076778] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.077295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.077295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.077391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.077611] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.077680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.077736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.077904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.077969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.078076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.078224] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.078365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.078365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.078512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.078647] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.078739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.078797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.078936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.079025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.079115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.079197] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.163178] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c46c4fd4-f6a3-4856-81c4-94599308df17: rpc.has_security_group_logging(os_id): False [ 868.184222] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.184371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.184445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.185196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.185589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.185671] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.185774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.185834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.186023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.186186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.186186] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 is going to be created. [ 868.211282] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c46c4fd4-f6a3-4856-81c4-94599308df17], does not exist path=[/infra/domains/default/groups/c46c4fd4-f6a3-4856-81c4-94599308df17]."\n}' [ 868.212383] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c46c4fd4-f6a3-4856-81c4-94599308df17 [ 868.212519] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 868.241273] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb: rpc.has_security_group_logging(os_id): False [ 868.271065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.271205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.271277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.271571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.272715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.273054] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.273489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.273489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.273489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.273587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.273750] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.273918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.274020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.274247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.274331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.274710] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c46c4fd4-f6a3-4856-81c4-94599308df17 is going to be created. [ 868.280974] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.280974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.280974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.280974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.299533] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c46c4fd4-f6a3-4856-81c4-94599308df17], does not exist path=[/infra/domains/default/groups/c46c4fd4-f6a3-4856-81c4-94599308df17]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c46c4fd4-f6a3-4856-81c4-94599308df17 [ 868.299533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c46c4fd4-f6a3-4856-81c4-94599308df17" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.299533] env[65381]: Traceback (most recent call last): [ 868.299533] env[65381]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 868.299533] env[65381]: return func(*args, **kwargs) [ 868.299533] env[65381]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 868.299533] env[65381]: res.raise_for_status() [ 868.299533] env[65381]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 868.299533] env[65381]: raise HTTPError(http_error_msg, response=self) [ 868.299533] env[65381]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c46c4fd4-f6a3-4856-81c4-94599308df17 [ 868.299533] env[65381]: During handling of the above exception, another exception occurred: [ 868.299533] env[65381]: Traceback (most recent call last): [ 868.299533] env[65381]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 868.299533] env[65381]: listener.cb(fileno) [ 868.299533] env[65381]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 868.299533] env[65381]: result = function(*args, **kwargs) [ 868.299533] env[65381]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 868.299533] env[65381]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 868.299533] env[65381]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 868.299533] env[65381]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 868.299533] env[65381]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 868.299533] env[65381]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 868.299533] env[65381]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 868.299533] env[65381]: res.raise_for_status() [ 868.299533] env[65381]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 868.299533] env[65381]: raise HTTPError(http_error_msg, response=self) [ 868.299533] env[65381]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c46c4fd4-f6a3-4856-81c4-94599308df17 [ 868.299533] env[65381]: Removing descriptor: 59 [ 868.309063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.310360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.311950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.311950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.311950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.311950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.311950] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.311950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.311950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.312923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.313099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.313351] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.313520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.313559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.313851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.313949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.314063] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 868.399083] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.399439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.399439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.399687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.399882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.417054] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 868.417275] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 868.417355] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 868.581944] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e917637-f523-43f9-9811-f2b68b364eb6: rpc.has_security_group_logging(os_id): False [ 868.605137] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.605715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.605715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.605715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.638241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.638508] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.638651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.638720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.638970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.639068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.639280] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.639386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.639449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.639608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.639789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.639874] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.640254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.640254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.640254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.640429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.640429] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 868.807566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.807566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.807566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.807566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.807801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.841265] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 869.679645] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 869.680056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.680056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.680277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.680466] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.680645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.680718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.680902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.680992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.681092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.681198] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.682110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.682505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.682505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.682644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.682644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.682727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.682802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.682889] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.186967] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.187243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.187563] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.434486] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 870.434486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.645901] env[65381]: INFO networking_nsxv3.common.synchronization [req-fb553b9c-347d-4182-afd3-c100ce5cab80 req-8fdb5093-af43-4165-915e-935621196794 tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 870.646458] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 870.646953] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.646953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.647110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.647593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.647804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.647900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.647952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.648130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.648217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.648314] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.693295] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.860409] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 870.860409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.151697] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.151905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.151905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.152855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.178020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.178332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.178456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.178702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.178747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.178816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.178893] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 871.198101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.198521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.198720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.199286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.199542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.201491] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be updated. [ 871.204762] env[65381]: INFO networking_nsxv3.common.synchronization [req-18adc4b3-ba09-4527-9009-2ccf183c653c req-0c9a5b7d-9f5d-4b31-b701-3e1303e5fa9d tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 871.205940] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 871.207698] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.207944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.208127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.208515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.208764] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.209428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.209428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.209428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.209428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.209664] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.222737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.223056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.223056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.223208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.223352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.234209] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 871.246942] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.247127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.247168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.247568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.247721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.260412] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 871.631850] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.632780] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.632780] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.632913] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.633237] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.633412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.633528] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.633756] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.633940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.634142] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.634266] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.634408] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.634524] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.634634] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.634738] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.634867] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.657583] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.657814] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.657963] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.658223] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.658563] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-11f5610e-37fb-465d-9eaf-abef333ede84 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.658742] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.658875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.659328] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.659561] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f5610e-37fb-465d-9eaf-abef333ede84',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.714534] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.714919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.715039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.715330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.715521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.715740] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.715856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.715938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.716169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.716266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.716355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 already deleted. [ 871.716449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.718732] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c88757cd-9d71-4ad8-8e40-27302aee2f63 None None] Enqueued Resource ID: 87f3e43a-e8be-46f0-b0d1-ed933f4f4707 with Priority: HIGHEST for action port [ 871.719316] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87f3e43a-e8be-46f0-b0d1-ed933f4f4707 with Priority: HIGHEST for action port [ 871.719696] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-87f3e43a-e8be-46f0-b0d1-ed933f4f4707 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.719887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87f3e43a-e8be-46f0-b0d1-ed933f4f4707" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.720038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87f3e43a-e8be-46f0-b0d1-ed933f4f4707" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.720330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87f3e43a-e8be-46f0-b0d1-ed933f4f4707" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.720454] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87f3e43a-e8be-46f0-b0d1-ed933f4f4707',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.162827] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.163254] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.163661] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.163661] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.163856] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.164057] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 11f5610e-37fb-465d-9eaf-abef333ede84 not found, creating... [ 872.164295] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.164469] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.164584] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.164825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.164959] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.165272] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.165460] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.165579] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.165827] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.165962] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.166143] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 11f5610e-37fb-465d-9eaf-abef333ede84 is going to be created. [ 872.187910] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.188123] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.188256] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.188561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.188814] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.189112] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.224284] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87f3e43a-e8be-46f0-b0d1-ed933f4f4707 [ 872.224284] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.224284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.224284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.224284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.224284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.224284] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87f3e43a-e8be-46f0-b0d1-ed933f4f4707 already deleted. [ 872.224284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87f3e43a-e8be-46f0-b0d1-ed933f4f4707" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.234564] env[65381]: INFO networking_nsxv3.common.synchronization [req-2d8ff178-b45f-4e52-931d-1356959330f1 req-1b11d964-e832-489b-8c66-b8d415586d6d tempest-MigrationsAdminTest-1004936190 tempest-MigrationsAdminTest-1004936190-project-member] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 872.237858] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 872.237858] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.237858] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.237858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.237858] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.741163] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.781969] env[65381]: INFO networking_nsxv3.common.synchronization [req-06d67c08-3bde-44a8-93f0-9c83e0d051ca req-5e056a0e-8fe6-4e23-9f4c-6b88de8ff5f1 tempest-ServerRescueTestJSONUnderV235-176747076 tempest-ServerRescueTestJSONUnderV235-176747076-project-member] Enqueued Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 872.782492] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c with Priority: HIGHEST for action security_group_members [ 872.782794] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.782896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.929302] env[65381]: INFO networking_nsxv3.common.synchronization [req-18adc4b3-ba09-4527-9009-2ccf183c653c req-51b3c3fc-511c-4b76-b06f-3d9bb8632174 service nova] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_rules [ 872.929302] env[65381]: INFO networking_nsxv3.common.synchronization [req-18adc4b3-ba09-4527-9009-2ccf183c653c req-51b3c3fc-511c-4b76-b06f-3d9bb8632174 service nova] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 872.929372] env[65381]: INFO networking_nsxv3.common.synchronization [req-18adc4b3-ba09-4527-9009-2ccf183c653c req-51b3c3fc-511c-4b76-b06f-3d9bb8632174 service nova] Enqueued Resource ID: 11f5610e-37fb-465d-9eaf-abef333ede84 with Priority: HIGHEST for action port [ 872.929901] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_rules [ 872.930079] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 872.930200] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11f5610e-37fb-465d-9eaf-abef333ede84 with Priority: HIGHEST for action port [ 872.930487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.931469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.931469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.931469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.931469] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.932346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.932346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.932346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.932543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.932652] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.932749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.932805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.932971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.933080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.933180] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.936783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-11f5610e-37fb-465d-9eaf-abef333ede84 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.936877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.936909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.939359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.939359] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11f5610e-37fb-465d-9eaf-abef333ede84',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.243752] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 873.244017] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 873.244177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.244443] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.270612] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 873.270909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.271591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.271849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.272137] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.272323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.272430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.272746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.272746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.272900] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.440150] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.440150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.440150] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.441279] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11f5610e-37fb-465d-9eaf-abef333ede84 with status ACTIVE [ 873.441344] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.441701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.441701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.441927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.442085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.442271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.442335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.442379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.442525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.442595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.442946] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.442946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.443065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.443154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.443258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.443345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11f5610e-37fb-465d-9eaf-abef333ede84 is going to be updated. [ 873.467253] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.467253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.467253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.467253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.467253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.467506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11f5610e-37fb-465d-9eaf-abef333ede84" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.748052] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.748286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.748356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.748581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.748717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.748856] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be updated. [ 873.774985] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.775179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.775220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.775458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.783197] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.783384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.783444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.783659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.783797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.794740] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: IN_PROGRESS for 2s [ 873.800908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.801410] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.801608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.801703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.801936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.802248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.802248] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be updated. [ 873.834364] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.835349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.835558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.835815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.835974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.847374] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 873.946043] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.118504] env[65381]: INFO networking_nsxv3.common.synchronization [None req-77c993d7-dd8e-4829-b450-d9fd46da822d None None] Enqueued Resource ID: 50d6ef1a-8be6-4037-99a0-0712416d43ff with Priority: HIGHEST for action port [ 874.119097] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50d6ef1a-8be6-4037-99a0-0712416d43ff with Priority: HIGHEST for action port [ 874.119424] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-50d6ef1a-8be6-4037-99a0-0712416d43ff taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.119551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50d6ef1a-8be6-4037-99a0-0712416d43ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.121191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50d6ef1a-8be6-4037-99a0-0712416d43ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.121191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50d6ef1a-8be6-4037-99a0-0712416d43ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.121191] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50d6ef1a-8be6-4037-99a0-0712416d43ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.450295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.450295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.450295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.450295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.450295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.450508] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be created. [ 874.480430] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.480535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.480585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.480807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.480986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.493156] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: UNINITIALIZED for 2s [ 874.622133] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50d6ef1a-8be6-4037-99a0-0712416d43ff [ 874.622388] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.622528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.622599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.622879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.622951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.623232] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50d6ef1a-8be6-4037-99a0-0712416d43ff already deleted. [ 874.623232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50d6ef1a-8be6-4037-99a0-0712416d43ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.656800] env[65381]: INFO networking_nsxv3.common.synchronization [req-a920d4a6-8f35-411a-b259-6fca4ffc99fd req-0bba7a6d-bc39-410f-870e-99bb275fe956 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 875.657624] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 875.658124] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.658346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.658468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.658797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.659819] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.659925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.659997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.660268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.660552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.660552] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.806339] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 875.806573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.857386] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 875.857386] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c deletion is rescheduled due to dependency. [ 875.857530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.858205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.858205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.858205] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.858370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.858370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.858571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.858668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.858776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.858960] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.859129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.859214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.859383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.859547] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.859663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.859742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.859914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.859981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.860117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.860223] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.861325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.861372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.861546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.861653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.861717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.861859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.861934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.862051] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.163558] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.163558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.163667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.163831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.185350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.185601] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.185725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.185787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.185981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.186081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.186170] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 876.213341] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.213484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.213546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.214126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.214126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.223066] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 876.350047] env[65381]: INFO networking_nsxv3.common.synchronization [req-7e54f1fb-8637-443d-841f-847655da3ed9 req-dc18de1b-a42c-414f-9459-d74cb03acd2e tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 876.350660] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 876.351328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.351328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.351328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.351328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.351542] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.351542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.351620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.351715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.351964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.352112] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.367766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.367954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.368084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.368346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.368457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.368664] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.368768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.368845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.369040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.369135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.369238] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be updated. [ 876.370881] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b719086a-b3a4-4011-8dd1-fa5d6f2d797c: rpc.has_security_group_logging(os_id): False [ 876.396400] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.396532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.396618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.396887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.397011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.397636] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.397636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.397636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.397636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.397636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.397913] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.397954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.398033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.398233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.398304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.398521] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.398632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.398689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.398825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.398900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.399328] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be updated. [ 876.404198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.404198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.404198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.404198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.404198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.413781] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 876.487806] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.487806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.487806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.487806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.488184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.501097] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: SUCCESS [ 876.501203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.501362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.501603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.501816] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.501947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.502027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.502198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.502280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.502397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.502498] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.504084] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: IN_PROGRESS for 2s [ 876.536775] env[65381]: INFO networking_nsxv3.common.synchronization [req-7e54f1fb-8637-443d-841f-847655da3ed9 req-05e83b15-64e9-4af4-a72f-48a12a6d3de0 tempest-ServersTestMultiNic-622930420 tempest-ServersTestMultiNic-622930420-project-member] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 876.537428] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGHEST for action security_group_members [ 876.537898] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.538102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.854381] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.006148] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.006298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.006393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.006623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.006790] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.007069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.007069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.007172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.007208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.007318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.007480] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.007572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.007655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.007804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.007958] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.008068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.008132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.008295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.008373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.008469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.008574] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.356358] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.511821] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ea7ac34-a800-4898-bb50-0dd416be04d0: rpc.has_security_group_logging(os_id): False [ 877.537244] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.537390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.537460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.537686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.537774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.537988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.538107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.538381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.538559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.538638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.538830] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.538950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.538992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.539135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.539210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.539384] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.539477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.539538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.539676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.539748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.539838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be created. [ 877.637210] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.637369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.637409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.638453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.638820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.653049] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: IN_PROGRESS for 2s [ 877.858421] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.858861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.858861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.858861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.858978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.858978] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 877.893168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.893168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.893168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.893168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.893168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.901823] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 878.233745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 878.233957] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 878.234110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.427041] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 878.427041] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c deletion is rescheduled due to dependency. [ 878.427041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.520485] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c in Status: SUCCESS [ 878.520708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.520895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.521439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.521439] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b719086a-b3a4-4011-8dd1-fa5d6f2d797c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.049522] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.049869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.049869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.050164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.050164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.050257] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b719086a-b3a4-4011-8dd1-fa5d6f2d797c is going to be deleted. [ 879.117306] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.117676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.117676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.118923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.118923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.118923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b719086a-b3a4-4011-8dd1-fa5d6f2d797c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.200131] env[65381]: INFO networking_nsxv3.common.synchronization [req-7b8218e6-38a6-49c0-8575-6e3e18d016a0 req-e760a84f-cc38-41db-9582-a43f572d5664 tempest-ListServerFiltersTestJSON-1861833264 tempest-ListServerFiltersTestJSON-1861833264-project-member] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 879.200748] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGHEST for action security_group_members [ 879.201230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.201670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.201670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.201670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.201877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.201959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.202016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.202163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.202248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.202406] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.670537] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: SUCCESS [ 879.670924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.704784] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.704980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.705047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.705326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.733859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.734231] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.734355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.734442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.734688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.734806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.734855] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be updated. [ 879.767301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.767554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.767554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.767816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.767927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.779205] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: IN_PROGRESS for 2s [ 879.808415] env[65381]: INFO networking_nsxv3.common.synchronization [req-ffe6705e-8277-4c4a-9904-4b97f468336b req-f82d41c9-e07f-4bd9-91fd-a4937d6f049d tempest-ServerGroupTestJSON-583954810 tempest-ServerGroupTestJSON-583954810-project-member] Enqueued Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_members [ 879.810056] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_members [ 879.810783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.810783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.810783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.811058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.811275] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.811496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.811496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.811670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.811780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.811919] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.914290] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 879.914557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.914803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.915119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.915375] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.915536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.915627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.915857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.915989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.916150] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.225700] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.226064] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-736" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.226064] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-736" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.226393] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-736" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.226652] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.226802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.226933] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.227148] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.227299] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.227552] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.227687] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.227794] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.227900] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.228016] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.228123] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.228250] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.249128] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.249128] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.249358] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.249450] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-736" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.249735] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-54b6d984-272a-4df9-9d3d-bf8f03c3963d taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.249907] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.250039] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.250335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.250461] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b6d984-272a-4df9-9d3d-bf8f03c3963d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.314283] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.314560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.314560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.314823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.314968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.315577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.315577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.315577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.315577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.315774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.315774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a58ced-f936-4d85-96d1-2772060a7aae already deleted. [ 880.315836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.419324] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.419324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.419324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.419324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.419324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.419645] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.419645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.419766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.419810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.419875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.419950] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be updated. [ 880.446169] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.448879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.448879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.448879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.448879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.465454] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: IN_PROGRESS for 2s [ 880.753525] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.753656] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.753691] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.754022] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.754240] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.754438] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 54b6d984-272a-4df9-9d3d-bf8f03c3963d not found, creating... [ 880.754730] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.754892] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.755016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.755254] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.755404] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.755706] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.755879] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.756264] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.756359] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.756496] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.756634] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 54b6d984-272a-4df9-9d3d-bf8f03c3963d is going to be created. [ 880.805865] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.806391] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.806851] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.807466] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.808825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.808825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.075732] env[65381]: INFO networking_nsxv3.common.synchronization [None req-cb265eb7-70f5-42f2-8856-c6c08c8e2f94 None None] Enqueued Resource ID: faeb3186-6d13-4db5-9ec3-0bf0be696cc9 with Priority: HIGHEST for action port [ 881.076476] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faeb3186-6d13-4db5-9ec3-0bf0be696cc9 with Priority: HIGHEST for action port [ 881.076605] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-faeb3186-6d13-4db5-9ec3-0bf0be696cc9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.076700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faeb3186-6d13-4db5-9ec3-0bf0be696cc9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.076770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faeb3186-6d13-4db5-9ec3-0bf0be696cc9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.077269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faeb3186-6d13-4db5-9ec3-0bf0be696cc9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.077478] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faeb3186-6d13-4db5-9ec3-0bf0be696cc9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.485374] env[65381]: INFO networking_nsxv3.common.synchronization [req-ffe6705e-8277-4c4a-9904-4b97f468336b req-3c2a049b-42ea-4886-b48a-726939c26dec service nova] Enqueued Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_rules [ 881.485374] env[65381]: INFO networking_nsxv3.common.synchronization [req-ffe6705e-8277-4c4a-9904-4b97f468336b req-3c2a049b-42ea-4886-b48a-726939c26dec service nova] Enqueued Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_members [ 881.485374] env[65381]: INFO networking_nsxv3.common.synchronization [req-ffe6705e-8277-4c4a-9904-4b97f468336b req-3c2a049b-42ea-4886-b48a-726939c26dec service nova] Enqueued Resource ID: 54b6d984-272a-4df9-9d3d-bf8f03c3963d with Priority: HIGHEST for action port [ 881.485374] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_rules [ 881.485374] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_members [ 881.489021] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b6d984-272a-4df9-9d3d-bf8f03c3963d with Priority: HIGHEST for action port [ 881.489021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.489021] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.489021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.489021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.489021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.489904] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.491427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-54b6d984-272a-4df9-9d3d-bf8f03c3963d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.492788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.494279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.494279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.494279] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54b6d984-272a-4df9-9d3d-bf8f03c3963d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.582568] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faeb3186-6d13-4db5-9ec3-0bf0be696cc9 [ 881.582568] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.582568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.582568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.582846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.582846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.582899] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faeb3186-6d13-4db5-9ec3-0bf0be696cc9 already deleted. [ 881.582963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faeb3186-6d13-4db5-9ec3-0bf0be696cc9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.699768] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-f988fb1f-9c76-4c24-9a67-8e01e6a2f37e tempest-ListServersNegativeTestJSON-693739231 tempest-ListServersNegativeTestJSON-693739231-project-member] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 881.699768] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 881.700189] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.700283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.700327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.700574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.700741] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.700838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.700905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.701075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.701159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.701451] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.789910] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a824681a-154e-415a-8473-76ea98ebc45a in Status: SUCCESS [ 881.790131] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a824681a-154e-415a-8473-76ea98ebc45a deletion is rescheduled due to dependency. [ 881.790250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.997378] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.997378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.997378] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.998218] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54b6d984-272a-4df9-9d3d-bf8f03c3963d with status ACTIVE [ 881.998525] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.999239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.999239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.999341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.999341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.999839] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.999839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.999839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.000804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.000804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.000804] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.000804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.000804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.001197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.001296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.001414] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54b6d984-272a-4df9-9d3d-bf8f03c3963d is going to be updated. [ 882.025702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.025837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.025907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.026131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.026272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.026433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54b6d984-272a-4df9-9d3d-bf8f03c3963d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.075825] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.076054] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.077317] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.077317] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.077317] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.077317] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.077317] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.077317] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.077717] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.077717] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.077717] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.077832] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.077982] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.077982] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.078148] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.078728] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.098660] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.098926] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.099084] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.099266] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.100051] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-4557f7db-7b59-4844-8572-e41cd64b6426 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.100051] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.100051] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.100263] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.100956] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4557f7db-7b59-4844-8572-e41cd64b6426',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.205356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.205356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.205356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.205356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.205356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.205534] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.205644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.205700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.205855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.205931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.206026] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad already deleted. [ 882.206108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.482113] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e917637-f523-43f9-9811-f2b68b364eb6 in Status: SUCCESS [ 882.482113] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 deletion is rescheduled due to dependency. [ 882.482113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.498546] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.603720] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.603947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.604141] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.604436] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.604583] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.604738] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 4557f7db-7b59-4844-8572-e41cd64b6426 not found, creating... [ 882.605011] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.605191] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.605306] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.605574] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.605758] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.606125] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.606295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.606410] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.606619] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.606749] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.606888] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 4557f7db-7b59-4844-8572-e41cd64b6426 is going to be created. [ 882.627030] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.627527] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.627527] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.627697] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.627877] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.628121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.000924] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.001195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.001282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.001541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.001619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.001679] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a58ced-f936-4d85-96d1-2772060a7aae is going to be created. [ 883.025275] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.025403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.025488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.025680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.025847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.035839] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a58ced-f936-4d85-96d1-2772060a7aae in Status: UNINITIALIZED for 2s [ 883.250165] env[65381]: INFO networking_nsxv3.common.synchronization [None req-177c3858-4e78-4ab1-8894-7fb7252a46c0 None None] Enqueued Resource ID: 25d80046-2df4-43f9-b89b-17d6c3d79bc3 with Priority: HIGHEST for action port [ 883.250758] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d80046-2df4-43f9-b89b-17d6c3d79bc3 with Priority: HIGHEST for action port [ 883.251097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-25d80046-2df4-43f9-b89b-17d6c3d79bc3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.251097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25d80046-2df4-43f9-b89b-17d6c3d79bc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.251253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25d80046-2df4-43f9-b89b-17d6c3d79bc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.252096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25d80046-2df4-43f9-b89b-17d6c3d79bc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.252096] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25d80046-2df4-43f9-b89b-17d6c3d79bc3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.360881] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-e80bb9ce-faaa-456a-9636-a61c49862bac service nova] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_rules [ 883.361711] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-e80bb9ce-faaa-456a-9636-a61c49862bac service nova] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 883.361711] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-e80bb9ce-faaa-456a-9636-a61c49862bac service nova] Enqueued Resource ID: 4557f7db-7b59-4844-8572-e41cd64b6426 with Priority: HIGHEST for action port [ 883.361711] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_rules [ 883.361894] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 883.361934] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4557f7db-7b59-4844-8572-e41cd64b6426 with Priority: HIGHEST for action port [ 883.362389] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.362389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.362389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.363285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.363285] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.364528] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.364528] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.364528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.364528] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.365465] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-4557f7db-7b59-4844-8572-e41cd64b6426 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.365465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.365465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.365644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.365695] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4557f7db-7b59-4844-8572-e41cd64b6426',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.753686] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25d80046-2df4-43f9-b89b-17d6c3d79bc3 [ 883.753992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.754451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.754451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.754451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.754543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.754574] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25d80046-2df4-43f9-b89b-17d6c3d79bc3 already deleted. [ 883.754652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25d80046-2df4-43f9-b89b-17d6c3d79bc3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.868650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.868816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.868945] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4557f7db-7b59-4844-8572-e41cd64b6426 with status ACTIVE [ 883.869182] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.869478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.869478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.869765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.869827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.869989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.870123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.870198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.870406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.870523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.870732] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.870867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.870941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.871176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.871252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.871377] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4557f7db-7b59-4844-8572-e41cd64b6426 is going to be updated. [ 883.872845] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.894490] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.894669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.894705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.894898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.895044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.895233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4557f7db-7b59-4844-8572-e41cd64b6426" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.184535] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-1441ec52-4157-4e6c-bf52-52026da7b737 tempest-ListServersNegativeTestJSON-693739231 tempest-ListServersNegativeTestJSON-693739231-project-member] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 884.185257] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 884.185679] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.185899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.375180] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.573540] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.574078] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.574078] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.574435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.574868] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.575184] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.575413] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.575792] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.576027] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.576418] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.577309] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.577309] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.577450] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.577507] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.579030] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.579030] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.618564] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.618840] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.618987] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.619178] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.620242] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-d38c81e0-2a2c-46ac-850d-3462794c6b37 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.620242] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.620436] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.621717] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.621717] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d38c81e0-2a2c-46ac-850d-3462794c6b37',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.878189] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.878442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.878442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.878625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.878711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.878810] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be created. [ 884.902609] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.902771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.902921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.903111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.903282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.913938] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: UNINITIALIZED for 2s [ 885.046197] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a58ced-f936-4d85-96d1-2772060a7aae in Status: SUCCESS [ 885.046326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.046478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.046697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.046905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.047037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.047103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.047280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.047365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.047455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.047544] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.127515] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.127789] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.127949] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.128301] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.128504] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.128718] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port d38c81e0-2a2c-46ac-850d-3462794c6b37 not found, creating... [ 885.129047] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.129295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.129419] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.129656] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.129787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.130119] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.130306] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.130426] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.130759] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.130759] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.130924] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: d38c81e0-2a2c-46ac-850d-3462794c6b37 is going to be created. [ 885.163939] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.163939] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.163939] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.163939] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.164272] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.164689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.342227] env[65381]: INFO networking_nsxv3.common.synchronization [req-4bc7fc40-c1b2-4e9c-bde3-59a7d851ac1c req-d54a45bc-a65d-4e3c-bab6-538f84ba257d tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 885.342679] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 885.344795] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.344795] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.344795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.344795] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.554222] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.554398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.554453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.554668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.554833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.554934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.554996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.555162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.555226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.555319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.555592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.555686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.555686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.555833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.555965] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.556074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.556119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.556249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.556318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.556395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.557246] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.849554] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.849554] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.849554] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 885.890670] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.891130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.891130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.891250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.891499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.907069] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 886.059386] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39a58ced-f936-4d85-96d1-2772060a7aae: rpc.has_security_group_logging(os_id): False [ 886.077811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.077975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.078060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.078287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.078418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.078576] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.078676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.078740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.078889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.078965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.079169] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.079267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.079327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.079474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.079545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.079726] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.079818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.079878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.080547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.080748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.080947] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a58ced-f936-4d85-96d1-2772060a7aae is going to be created. [ 886.149051] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.149225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.149296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.149507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.149692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.161062] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a58ced-f936-4d85-96d1-2772060a7aae in Status: IN_PROGRESS for 2s [ 886.319725] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-afcc30b7-5383-4f63-aac1-8dd1bee5c3db service nova] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_rules [ 886.319928] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-afcc30b7-5383-4f63-aac1-8dd1bee5c3db service nova] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 886.320055] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-afcc30b7-5383-4f63-aac1-8dd1bee5c3db service nova] Enqueued Resource ID: d38c81e0-2a2c-46ac-850d-3462794c6b37 with Priority: HIGHEST for action port [ 886.320596] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_rules [ 886.320732] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 886.320839] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38c81e0-2a2c-46ac-850d-3462794c6b37 with Priority: HIGHEST for action port [ 886.321125] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.321272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.321420] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.321503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.321841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-d38c81e0-2a2c-46ac-850d-3462794c6b37 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.321841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.321841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.322076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.322158] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d38c81e0-2a2c-46ac-850d-3462794c6b37',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.656020] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-534675bd-d6cc-4052-8198-5e15ba066d73 tempest-ListServersNegativeTestJSON-693739231 tempest-ListServersNegativeTestJSON-693739231-project-member] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 886.656446] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 886.656922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.657212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.725962] env[65381]: INFO networking_nsxv3.common.synchronization [req-8c66bbe1-433d-47cc-95c0-5d5aef5cebe6 req-3596f746-b8a0-43a7-b622-06e590594dfe tempest-ServersTestManualDisk-1163278782 tempest-ServersTestManualDisk-1163278782-project-member] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_members [ 886.726592] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGHEST for action security_group_members [ 886.726915] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.727049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.727218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.727323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.727479] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.727603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.727681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.728790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.728790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.728790] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.826404] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d38c81e0-2a2c-46ac-850d-3462794c6b37 with status ACTIVE [ 886.826654] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.826811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.826885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.827162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.827286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.827439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.827547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.827595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.827748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.827843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.828012] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.828113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.828176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.828758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.828758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.828758] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d38c81e0-2a2c-46ac-850d-3462794c6b37 is going to be updated. [ 886.850337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.850574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.850574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.851347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.851347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.851347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d38c81e0-2a2c-46ac-850d-3462794c6b37" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.924203] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 886.924575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.924575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.924984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.924984] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.925121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.925173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.925308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.925380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.925464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.925617] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.926582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.926753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.926908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.927017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.927228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.927587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.927587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.927587] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.103249] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.104058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.104058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.104058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.104683] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.108120] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.108120] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.108120] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.108120] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.108120] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.108120] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.108120] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.108120] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.108120] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.108120] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.108120] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.133345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.133345] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.133345] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.133345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-947" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.133345] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-42d1ca20-7268-4003-8d2c-9c58ca4bb107 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.133345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.133345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.133345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.133345] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d1ca20-7268-4003-8d2c-9c58ca4bb107',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.230481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.230680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.230759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.231061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.254870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.255133] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.255241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.255307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.255720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.255720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.255720] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 is going to be updated. [ 887.285733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.285843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.285914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.286144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.286287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.298400] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 in Status: IN_PROGRESS for 2s [ 887.429311] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.429471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.431835] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.636258] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.636421] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.636421] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.637036] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.637036] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.637148] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 42d1ca20-7268-4003-8d2c-9c58ca4bb107 not found, creating... [ 887.637371] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.637614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.637758] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.638070] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.638427] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.638624] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.638822] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.638912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.639355] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.639496] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.639645] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 42d1ca20-7268-4003-8d2c-9c58ca4bb107 is going to be created. [ 887.663675] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.663675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.663675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.663675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.663675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.663675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.917613] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 887.917891] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb deletion is rescheduled due to dependency. [ 887.918020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.934516] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.176975] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39a58ced-f936-4d85-96d1-2772060a7aae in Status: SUCCESS [ 888.177154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.418024] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-39c5ce5b-ce58-414f-9899-f752c504745d service nova] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_rules [ 888.418024] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-39c5ce5b-ce58-414f-9899-f752c504745d service nova] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 888.418024] env[65381]: INFO networking_nsxv3.common.synchronization [req-170e87bd-29d2-4652-8fc4-cb254e43ac73 req-39c5ce5b-ce58-414f-9899-f752c504745d service nova] Enqueued Resource ID: 42d1ca20-7268-4003-8d2c-9c58ca4bb107 with Priority: HIGHEST for action port [ 888.418024] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_rules [ 888.418024] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 888.418024] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42d1ca20-7268-4003-8d2c-9c58ca4bb107 with Priority: HIGHEST for action port [ 888.418024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.418024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.418914] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.419257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.419601] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-42d1ca20-7268-4003-8d2c-9c58ca4bb107 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.419888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.420186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.420502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.421083] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42d1ca20-7268-4003-8d2c-9c58ca4bb107',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.437382] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.437382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.437382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.437725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.437878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.438048] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 888.473266] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.473485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.474157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.474157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.474157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.484560] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 888.924766] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42d1ca20-7268-4003-8d2c-9c58ca4bb107 with status ACTIVE [ 888.924908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.925122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.925225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.925924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.925924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.925924] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.926112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.926190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.926414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.926531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.926811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.926954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.927067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.927282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.927398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.927526] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42d1ca20-7268-4003-8d2c-9c58ca4bb107 is going to be updated. [ 888.950868] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.951389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.951389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.951502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.952244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.952244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42d1ca20-7268-4003-8d2c-9c58ca4bb107" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.308957] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 in Status: SUCCESS [ 889.309168] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 deletion is rescheduled due to dependency. [ 889.309305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.408498] env[65381]: INFO networking_nsxv3.common.synchronization [req-9dfcc37e-f904-48d9-afef-b498abe3c5dc req-1bf5cb9c-5322-4203-af6c-cfa6399b8da5 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_members [ 889.409057] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_members [ 889.409366] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.409489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.409553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.409819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.409969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.410109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.410167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.410355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.410426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.410474] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.723592] env[65381]: INFO networking_nsxv3.common.synchronization [req-10193881-ecab-42b9-88ba-9f0320aa9988 req-dc0a7d84-3e74-4724-8801-0a8ad7e9e47a tempest-ServersAdminTestJSON-1857654510 tempest-ServersAdminTestJSON-1857654510-project-member] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 889.724436] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGHEST for action security_group_members [ 889.724838] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.724994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.724994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.725406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.725511] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.725656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.725656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.725817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.728046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.728046] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.814133] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.814397] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.814618] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.815055] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.815445] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.815863] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.815902] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.816252] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.816434] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.816733] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.816870] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.817066] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.817195] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.817350] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.817510] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.817742] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.841402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.841928] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.841928] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.842179] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.843095] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-579dded1-064e-42f2-942d-4726f2677fe1 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.843095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.843095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.844086] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.844307] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('579dded1-064e-42f2-942d-4726f2677fe1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.912289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.912517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.912517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.912716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.912804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.913032] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.913164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.913212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.913435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.913435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.913549] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c already deleted. [ 889.913549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.231721] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.231977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.231977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.232194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.256922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.257232] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.257560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.257560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.257979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.257979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.257979] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be updated. [ 890.287792] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.287929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.288014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.288226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.288378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.304336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: IN_PROGRESS for 2s [ 890.347194] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.347426] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.347550] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.347867] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.348016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.348498] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 579dded1-064e-42f2-942d-4726f2677fe1 not found, creating... [ 890.348873] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.349063] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.349207] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.349417] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.349551] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.350064] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.350064] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.350182] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.350409] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.350556] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.350710] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 579dded1-064e-42f2-942d-4726f2677fe1 is going to be created. [ 890.374847] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.375183] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.375324] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.375669] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.375945] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.376231] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.496888] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 890.496888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.496888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.497354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.497354] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.497464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.497558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.497721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.497805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.497901] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.000150] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.184581] env[65381]: INFO networking_nsxv3.common.synchronization [req-9dfcc37e-f904-48d9-afef-b498abe3c5dc req-fcb0e37f-20e8-4ed9-92d7-45818dc37752 service nova] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_rules [ 891.185433] env[65381]: INFO networking_nsxv3.common.synchronization [req-9dfcc37e-f904-48d9-afef-b498abe3c5dc req-fcb0e37f-20e8-4ed9-92d7-45818dc37752 service nova] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_members [ 891.185433] env[65381]: INFO networking_nsxv3.common.synchronization [req-9dfcc37e-f904-48d9-afef-b498abe3c5dc req-fcb0e37f-20e8-4ed9-92d7-45818dc37752 service nova] Enqueued Resource ID: 579dded1-064e-42f2-942d-4726f2677fe1 with Priority: HIGHEST for action port [ 891.185548] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_rules [ 891.186379] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_members [ 891.186379] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579dded1-064e-42f2-942d-4726f2677fe1 with Priority: HIGHEST for action port [ 891.186379] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.186379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.186379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.186379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.186644] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.187655] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.187655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.187756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.187906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.188071] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.188392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.188392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.188392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.188718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.188718] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.189363] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-579dded1-064e-42f2-942d-4726f2677fe1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.189457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.190056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.190056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.190056] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('579dded1-064e-42f2-942d-4726f2677fe1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.507528] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.634044] env[65381]: INFO networking_nsxv3.common.synchronization [req-6a583f97-df51-4e93-a4a9-4987c43b4ca4 req-8f80dc75-6d91-410f-8597-f7ce376b4710 tempest-ServerGroupTestJSON-583954810 tempest-ServerGroupTestJSON-583954810-project-member] Enqueued Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_members [ 891.635318] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGHEST for action security_group_members [ 891.635404] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.635490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.635542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.635750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.635935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.635998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.636074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.636228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.636314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.636411] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.691574] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.692734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.693029] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.694015] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 579dded1-064e-42f2-942d-4726f2677fe1 with status ACTIVE [ 891.694256] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.694379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.694483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.695579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.695683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.695872] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.696453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.696453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.696453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.696453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.696719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.696719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.696821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.696850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696919] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 579dded1-064e-42f2-942d-4726f2677fe1 is going to be updated. [ 891.721531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.721692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.721750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.721946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.722096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.722266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-579dded1-064e-42f2-942d-4726f2677fe1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.010664] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.010845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.010934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.011699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.011845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.012023] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 892.045841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.046062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.046062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.046403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.046438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.058226] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 892.138183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.138354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.138426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.138644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.138797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.138931] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.139033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.139099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.139249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.139323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.139459] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a58ced-f936-4d85-96d1-2772060a7aae is going to be updated. [ 892.169416] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.169564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.169626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.169836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.171495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.181708] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a58ced-f936-4d85-96d1-2772060a7aae in Status: IN_PROGRESS for 2s [ 892.199011] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.315466] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 in Status: SUCCESS [ 892.315998] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 deletion is rescheduled due to dependency. [ 892.316257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.704431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.704431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.704431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.704431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.704431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.704431] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c is going to be created. [ 892.729334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.729512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.729546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.729739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.729901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.743570] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495a081-8211-4db6-af3d-10fc0b2f521c in Status: UNINITIALIZED for 2s [ 894.070294] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 894.070721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.070721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.070804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.071221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.071221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.071221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.071401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.071401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.071479] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.192191] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39a58ced-f936-4d85-96d1-2772060a7aae in Status: SUCCESS [ 894.192407] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39a58ced-f936-4d85-96d1-2772060a7aae deletion is rescheduled due to dependency. [ 894.192603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.575040] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.755080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495a081-8211-4db6-af3d-10fc0b2f521c in Status: SUCCESS [ 894.755320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.755555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.755799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.756027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.756155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.756218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.756409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.756572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.756608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.757246] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.980543] env[65381]: INFO networking_nsxv3.common.synchronization [req-db32966c-c779-4b19-b8d6-ad4bc36c2ee0 req-c82dfa8e-f9c4-450e-8e61-3106672ef50e tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 894.981249] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 894.981534] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.981669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.982293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.982293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.982707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.982938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.983018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.983244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.983335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.983431] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.077965] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.260026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.297981] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.297981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.297981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.297981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.297981] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.299388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.299388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.299388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.299388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.299388] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.299388] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.299388] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.299388] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.299388] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.299673] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.299673] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.319670] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.319842] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.319983] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.320208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.320526] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-1854e81e-f747-4dab-87e9-5291667e18ae taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.320726] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.320814] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.321324] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.321480] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1854e81e-f747-4dab-87e9-5291667e18ae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.485666] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.485871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.485908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.486130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.486239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.486433] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.486523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.486584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.486738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.486813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.486900] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 895.518236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.518422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.518459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.518687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.518840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.530170] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 895.580098] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.580240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.580369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.580624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.580761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.580889] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 895.611339] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.611553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.611553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.611767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.611928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.622192] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 895.761725] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b495a081-8211-4db6-af3d-10fc0b2f521c: rpc.has_security_group_logging(os_id): False [ 895.799990] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.799990] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.799990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.799990] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c is going to be created. [ 895.824197] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.824197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.824197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.824958] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.825205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.825468] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 1854e81e-f747-4dab-87e9-5291667e18ae not found, creating... [ 895.825833] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.826220] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.826433] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.826845] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.827059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.827394] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.827569] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.827686] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.827928] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.828075] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.828217] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 1854e81e-f747-4dab-87e9-5291667e18ae is going to be created. [ 895.858079] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.858309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.860043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.860043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.860043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.860043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.903319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.903425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.903535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.903732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.903924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.918262] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495a081-8211-4db6-af3d-10fc0b2f521c in Status: IN_PROGRESS for 2s [ 896.571016] env[65381]: INFO networking_nsxv3.common.synchronization [req-db32966c-c779-4b19-b8d6-ad4bc36c2ee0 req-db2b734c-771b-493e-b0cf-289e5f3b3338 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 896.571287] env[65381]: INFO networking_nsxv3.common.synchronization [req-db32966c-c779-4b19-b8d6-ad4bc36c2ee0 req-db2b734c-771b-493e-b0cf-289e5f3b3338 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 896.571376] env[65381]: INFO networking_nsxv3.common.synchronization [req-db32966c-c779-4b19-b8d6-ad4bc36c2ee0 req-db2b734c-771b-493e-b0cf-289e5f3b3338 service nova] Enqueued Resource ID: 1854e81e-f747-4dab-87e9-5291667e18ae with Priority: HIGHEST for action port [ 896.572463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 896.572639] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 896.572800] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1854e81e-f747-4dab-87e9-5291667e18ae with Priority: HIGHEST for action port [ 896.573228] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.573488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.573488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.573620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.573702] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.574808] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.574808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.574929] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-1854e81e-f747-4dab-87e9-5291667e18ae taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.575031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.575162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.575374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.575570] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1854e81e-f747-4dab-87e9-5291667e18ae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.077344] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.077475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.077682] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1854e81e-f747-4dab-87e9-5291667e18ae with status ACTIVE [ 897.077850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.077957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.078031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.078244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.078331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.078500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.078594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.078653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.078801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.078875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.079066] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.079165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.079215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.079405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.079436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.079507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1854e81e-f747-4dab-87e9-5291667e18ae is going to be updated. [ 897.103212] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.103403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.103504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.103757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.103921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.104194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1854e81e-f747-4dab-87e9-5291667e18ae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.541068] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 897.541273] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 897.541346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.541489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.541910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.542117] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.542239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.542301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.542458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.542540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.542634] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.635022] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 897.635383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.635383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.635626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.635829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.635948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.636032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.636248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.636324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.636434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.637111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.637111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.637111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.637111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.637111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.637111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.637460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.637460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.637460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.637460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.637585] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.638361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.638524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.638684] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.638811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.638870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.639019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.639095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.639182] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.931747] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b495a081-8211-4db6-af3d-10fc0b2f521c in Status: SUCCESS [ 897.931747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.047477] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.141011] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5819134c-7e49-4e7e-b983-fb61c5b540ad: rpc.has_security_group_logging(os_id): False [ 898.142278] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.162884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.163043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.163105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.163358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.163448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.163708] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.163819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.163883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.164047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.164161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.164301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.164417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.164491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.164638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.164712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.164897] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.164990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.165063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.165201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.165276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.165361] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be created. [ 898.225120] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.225308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.225394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.225643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.225826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.237464] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 898.550360] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.644931] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.053174] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.053404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.053520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.053947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.054119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.054270] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 899.084484] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.084681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.084751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.085105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.085346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.099378] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 899.148657] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.148657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.148764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.148986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.149097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.149209] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 899.188833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.188833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.188833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.189160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.189299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.201552] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 900.251354] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 900.251676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.251763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.251986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.252088] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.754158] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.754420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.780820] env[65381]: INFO networking_nsxv3.common.synchronization [req-1fa7b828-6c3d-4049-b698-b98187837f67 req-3e04fa60-8627-4008-a06f-601d7dcb61c2 tempest-ListServersNegativeTestJSON-693739231 tempest-ListServersNegativeTestJSON-693739231-project-member] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 900.780820] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 900.781734] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.781734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.113859] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 901.114046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.114163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.114518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.114723] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.114867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.114911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.115079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.115162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.115436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.115436] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.213345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 901.213598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.213788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.215447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.215447] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.215447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.215447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.215447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.215447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.215447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.215447] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.216682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.216929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.217185] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.217302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.217440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.217487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.217565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.217695] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.618229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.618541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.618541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.618675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.618841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.618943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.619016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.619216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.619265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.619349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.619529] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.619602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.619670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.619791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.619927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.620027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.620085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.620224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.620301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.620384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.620484] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.717848] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.717999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.719310] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.123639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9c03ef0-b5e2-4757-9488-6558cc6e9841: rpc.has_security_group_logging(os_id): False [ 902.144827] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.145081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.145204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.145525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.145690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.146022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.146194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.146301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.146552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.146675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.147869] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.147869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.147869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.147869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.147869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.148067] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.148230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.148352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.148556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.148679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.148814] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 902.221385] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.241899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.242169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.242169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.242330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.242476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.258071] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 902.724963] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.725512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.725650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.725980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.726117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.726293] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 902.778140] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.778311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.778371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.778607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.778967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.789844] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 903.753918] env[65381]: INFO networking_nsxv3.common.synchronization [req-8580dc00-6b80-4f7a-958c-d47902585b11 req-57eb5da2-606f-49d3-8763-ae79d4195e80 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 903.754838] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 903.755218] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.755445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.755579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.755894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.756204] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.756312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.756399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.756689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.756867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.757064] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.019218] env[65381]: INFO networking_nsxv3.common.synchronization [req-0b1bc1a4-31af-4482-9a5c-0feba9503d82 req-9e88e2b0-5da5-4d61-b50a-f3026a39e172 tempest-MigrationsAdminTest-1004936190 tempest-MigrationsAdminTest-1004936190-project-member] Enqueued Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 904.019528] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb17e366-3b38-46cd-836a-5d640fa33c5a with Priority: HIGHEST for action security_group_members [ 904.019966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb17e366-3b38-46cd-836a-5d640fa33c5a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.020171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.020269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.020521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.020713] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.020840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.020924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.021122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.021322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.021449] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb17e366-3b38-46cd-836a-5d640fa33c5a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.261975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.264152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.264152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.264152] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be updated. [ 904.284800] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 904.285124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.301059] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.301059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.301059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.301059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.301059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.316307] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: IN_PROGRESS for 2s [ 904.525115] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.525115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.525115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.525115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.556018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.556018] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.556018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.556018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.556018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.556018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.556018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a is going to be updated. [ 904.591369] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.591568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.591649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.591884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.592045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.602905] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: IN_PROGRESS for 2s [ 904.804409] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.804409] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.804409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.805635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.806165] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.806754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.806922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.807705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.808578] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.808911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.809098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.811638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.811638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.811638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.811638] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.998791] env[65381]: INFO networking_nsxv3.common.synchronization [req-a38da34d-e047-4d1d-b75a-7405b552c60b req-4913cd62-a952-4aa5-8156-69f8a15be88f tempest-FloatingIPsAssociationTestJSON-1528714218 tempest-FloatingIPsAssociationTestJSON-1528714218-project-member] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 904.999275] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 905.000196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.000327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.000399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.000660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.000827] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.000937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.001009] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.001234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.001322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.001421] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.314456] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5819134c-7e49-4e7e-b983-fb61c5b540ad: rpc.has_security_group_logging(os_id): False [ 905.334042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.334288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.334288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.334538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.334662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.335039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.335133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.335198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.335401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.335510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.335763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.335901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.335992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.336205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.336314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.336592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.336722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.336829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.337012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.337153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.337293] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 905.343468] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.343659] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.344026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.344268] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.344647] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.344885] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.345083] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.346169] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.346169] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.346169] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.346169] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.346169] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.346369] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.346487] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.346600] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.346795] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.365708] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.365865] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.366020] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.366855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.366855] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-1134a0a8-84bc-4036-a36f-943b6f5b6656 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.366855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.366855] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.367114] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.367259] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1134a0a8-84bc-4036-a36f-943b6f5b6656',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.404850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.404995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.405078] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.405278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.405576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.419401] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 905.503571] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.503728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.503800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.504048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.504150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.504355] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.504457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.504519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.504673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.504751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.504837] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 already deleted. [ 905.504915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.870687] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.870687] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.870687] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.871131] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.871131] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.871131] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 1134a0a8-84bc-4036-a36f-943b6f5b6656 not found, creating... [ 905.871287] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.871446] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.871557] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.871779] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.871914] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.872221] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.872377] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.872492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.872697] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.872824] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.872976] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 1134a0a8-84bc-4036-a36f-943b6f5b6656 is going to be created. [ 905.893863] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.894046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.894376] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.894764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.895336] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.895336] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.328089] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: SUCCESS [ 906.328375] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 deletion is rescheduled due to dependency. [ 906.328521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.615180] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb17e366-3b38-46cd-836a-5d640fa33c5a in Status: SUCCESS [ 906.615682] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb17e366-3b38-46cd-836a-5d640fa33c5a deletion is rescheduled due to dependency. [ 906.615682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb17e366-3b38-46cd-836a-5d640fa33c5a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.624603] env[65381]: INFO networking_nsxv3.common.synchronization [req-a38da34d-e047-4d1d-b75a-7405b552c60b req-155a74ae-1846-4f97-9d45-56e282f50a75 service nova] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_rules [ 906.624603] env[65381]: INFO networking_nsxv3.common.synchronization [req-a38da34d-e047-4d1d-b75a-7405b552c60b req-155a74ae-1846-4f97-9d45-56e282f50a75 service nova] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 906.624603] env[65381]: INFO networking_nsxv3.common.synchronization [req-a38da34d-e047-4d1d-b75a-7405b552c60b req-155a74ae-1846-4f97-9d45-56e282f50a75 service nova] Enqueued Resource ID: 1134a0a8-84bc-4036-a36f-943b6f5b6656 with Priority: HIGHEST for action port [ 906.625400] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_rules [ 906.625640] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 906.625802] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1134a0a8-84bc-4036-a36f-943b6f5b6656 with Priority: HIGHEST for action port [ 906.626495] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.626495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.626632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.627051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.627051] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.628823] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.629133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.629133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.629457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.629659] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.629829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.629989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.630212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.630887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.630887] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.631681] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-1134a0a8-84bc-4036-a36f-943b6f5b6656 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.631874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.631998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.632283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.632418] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1134a0a8-84bc-4036-a36f-943b6f5b6656',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.129955] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.130252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.134642] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.135577] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1134a0a8-84bc-4036-a36f-943b6f5b6656 with status ACTIVE [ 907.136690] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.136690] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.136690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.137199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.137199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.137199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.137199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.137423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.137500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.137588] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1134a0a8-84bc-4036-a36f-943b6f5b6656 is going to be updated. [ 907.160553] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.160553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.160553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.160553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.160553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.160553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1134a0a8-84bc-4036-a36f-943b6f5b6656" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.324279] env[65381]: INFO networking_nsxv3.common.synchronization [req-1d84cf33-122e-4367-8b33-8214641d7c85 req-dfc7a5dc-ca72-47aa-803b-fe856ea75c71 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 907.324837] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 907.325166] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.325295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.325352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.325593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.325741] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.325819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.325869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.326022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.326107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.326204] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.433437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 907.433630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.433855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.434100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.434309] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.641496] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.650505] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.651267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.651267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.651267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.651533] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.651878] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.652881] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.652881] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.652881] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.653046] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.653147] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.653669] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.653669] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.653669] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.653669] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.653845] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.675807] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.676882] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.676882] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.676882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.676882] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-12c879bb-44b1-4732-adf0-1669ba1fcfc5 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.676882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.677177] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.677314] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.677446] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12c879bb-44b1-4732-adf0-1669ba1fcfc5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.829298] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.829494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.829537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.829757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.829846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.830052] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.830182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.830262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.830382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.830467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.830559] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 907.864299] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.864501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.864501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.864712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.864865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.874711] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 907.936962] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.937195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.937195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.937407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.937581] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.937684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.937747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.937902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.937996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.938084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.938178] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.143321] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.143667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.143667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.143838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.143898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.143989] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be created. [ 908.169248] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.169403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.169451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.169653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.169813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.179515] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: UNINITIALIZED for 2s [ 908.179902] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.180153] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.180357] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.180764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.180936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.181094] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 12c879bb-44b1-4732-adf0-1669ba1fcfc5 not found, creating... [ 908.181355] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.181519] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.181635] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.181863] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.182193] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.182306] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.182490] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.182635] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.182868] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.183011] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.183152] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 12c879bb-44b1-4732-adf0-1669ba1fcfc5 is going to be created. [ 908.205660] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.205660] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.205660] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.205897] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.206123] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.206417] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.440452] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.440619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.440706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.440947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441124] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.441227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.441293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.441450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.441626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.441774] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.441868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.441931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.442088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.442469] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.442469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.442469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.442586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.442586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.442640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.442715] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.945735] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5819134c-7e49-4e7e-b983-fb61c5b540ad: rpc.has_security_group_logging(os_id): False [ 908.948535] env[65381]: INFO networking_nsxv3.common.synchronization [req-1d84cf33-122e-4367-8b33-8214641d7c85 req-cdec407b-0f55-40ee-9d7d-977acc928c95 service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 908.948740] env[65381]: INFO networking_nsxv3.common.synchronization [req-1d84cf33-122e-4367-8b33-8214641d7c85 req-cdec407b-0f55-40ee-9d7d-977acc928c95 service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 908.948914] env[65381]: INFO networking_nsxv3.common.synchronization [req-1d84cf33-122e-4367-8b33-8214641d7c85 req-cdec407b-0f55-40ee-9d7d-977acc928c95 service nova] Enqueued Resource ID: 12c879bb-44b1-4732-adf0-1669ba1fcfc5 with Priority: HIGHEST for action port [ 908.949621] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 908.949699] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 908.949841] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c879bb-44b1-4732-adf0-1669ba1fcfc5 with Priority: HIGHEST for action port [ 908.950690] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.950690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.950990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.951295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.951295] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.952199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.952259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.953135] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-12c879bb-44b1-4732-adf0-1669ba1fcfc5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.953135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.953135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.953401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.953401] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12c879bb-44b1-4732-adf0-1669ba1fcfc5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.995291] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.995498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.995498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.996157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.996157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.996262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.996384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.996540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.996761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.996895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.997571] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.997571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.997571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.997844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.997844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.998197] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.998302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.998427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.998685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.998809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.998952] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 909.089101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.089277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.089277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.089462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.090042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.106123] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 909.455238] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.455576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.455675] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12c879bb-44b1-4732-adf0-1669ba1fcfc5 with status ACTIVE [ 909.455891] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.456019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.456085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.456448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.456535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.456710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.456808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.456871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.457044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.457123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.457463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.457657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.457715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.457847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.457925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.458025] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12c879bb-44b1-4732-adf0-1669ba1fcfc5 is going to be updated. [ 909.481917] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.482117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.482195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.482426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.482582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.482734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12c879bb-44b1-4732-adf0-1669ba1fcfc5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.886176] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 909.886366] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 909.886478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.886645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.886852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.887047] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.887169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.887246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.887388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.887469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.887563] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.189784] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 910.190015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.190219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.190469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.190852] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.190852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.190949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.191091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.191176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.191264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.191361] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.394533] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.694107] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.694484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.694484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.694572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.696115] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.696115] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.696115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.696503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.696503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.696568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.696697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.696866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.696932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.697088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.697245] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.897773] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.143040] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 911.143336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.199612] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c007b86e-f555-43b0-9e5a-60b1b4faffb3: rpc.has_security_group_logging(os_id): False [ 911.220674] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.220838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.220881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.221136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.221251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.221472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.221583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.221662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.221854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.221930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.222173] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.222278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.222343] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.222489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.222570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.222806] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.222907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.222964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.223120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.223277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.223345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be created. [ 911.289059] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.289187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.289248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.289440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.289617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.303299] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: IN_PROGRESS for 2s [ 911.401677] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.401840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.401917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.402155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.402248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.402347] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 911.444239] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.444420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.444553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.444905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.445198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.455641] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 913.316096] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 913.316388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.480518] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.481745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.481745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.482128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.482128] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.951513] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 913.951649] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 913.984305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.984487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.984569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.984786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.984943] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.985077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.985113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.985257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.985344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.985430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.985574] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.985665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.985725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.985863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.985995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.986100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.986157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.986375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.986536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.986536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.986610] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.488507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f08ea40-f56b-4bd5-a0f9-e991cad65528: rpc.has_security_group_logging(os_id): False [ 914.508856] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.508856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.509360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.509360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.509360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.509505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.509575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.509575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.509737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.509810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.510027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.510164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.510219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.511069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.511069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.511069] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.511069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.511069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.511069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.511069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.511069] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 914.573034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.573309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.573309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.573545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.573702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.589884] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 916.606810] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 916.607106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.678497] env[65381]: INFO networking_nsxv3.common.synchronization [req-ff52ffda-65bf-4fb8-ab09-6cf40f1e57ea req-a693121c-64e5-481b-aaf6-19cc2a7b08c1 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 917.679077] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 917.679399] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.679579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.679579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.679832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.679998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.680112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.680178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.680574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.680574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.680574] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.042531] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.042733] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.042856] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.043225] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.043587] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.043772] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.043893] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.044133] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.044278] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.044504] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.044616] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.044724] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.044829] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.044935] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.045051] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.045184] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.065471] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.065645] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.065765] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.066128] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.066259] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.066432] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.066566] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.066879] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.067106] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7bc9ba-30ae-441a-bff2-b9912cbd71c4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.133180] env[65381]: INFO networking_nsxv3.common.synchronization [None req-2e9c691b-34f4-4d31-956c-022d26ae0ca3 None None] Enqueued Resource ID: 287a997e-73b7-4757-b2c5-9f690375ce45 with Priority: HIGHEST for action port [ 918.133526] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287a997e-73b7-4757-b2c5-9f690375ce45 with Priority: HIGHEST for action port [ 918.134103] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-287a997e-73b7-4757-b2c5-9f690375ce45 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.134246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-287a997e-73b7-4757-b2c5-9f690375ce45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.134395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-287a997e-73b7-4757-b2c5-9f690375ce45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.134606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-287a997e-73b7-4757-b2c5-9f690375ce45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.134704] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('287a997e-73b7-4757-b2c5-9f690375ce45',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.184468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.184719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.184808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.185038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.185135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.185338] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.185438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.185495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.186013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.186101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.186191] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 already deleted. [ 918.186276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.569642] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.569815] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.569942] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.570246] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.570396] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.570567] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 not found, creating... [ 918.570823] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.570981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.571111] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.571365] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.571493] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.571779] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.571928] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.572048] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.572260] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.572390] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.572529] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 is going to be created. [ 918.596432] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.596884] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.596884] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.597046] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.597280] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.597531] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.636933] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 287a997e-73b7-4757-b2c5-9f690375ce45 [ 918.637200] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.637345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.637424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.637643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.637734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.637830] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:287a997e-73b7-4757-b2c5-9f690375ce45 already deleted. [ 918.637913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-287a997e-73b7-4757-b2c5-9f690375ce45" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.202538] env[65381]: INFO networking_nsxv3.common.synchronization [req-92c41bfd-7648-4be7-8aae-28bbf94f7b5e req-4eea7cce-738a-4a92-bbc8-0baa43876251 tempest-ServersWithSpecificFlavorTestJSON-513012973 tempest-ServersWithSpecificFlavorTestJSON-513012973-project-member] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 919.202538] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGHEST for action security_group_members [ 919.202538] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.203306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.203606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.204223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.204223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.204371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.204519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.204674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.205158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.205158] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.322461] env[65381]: INFO networking_nsxv3.common.synchronization [req-ff52ffda-65bf-4fb8-ab09-6cf40f1e57ea req-79b260e1-6eeb-4da0-a214-17d1cc57e915 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 919.322731] env[65381]: INFO networking_nsxv3.common.synchronization [req-ff52ffda-65bf-4fb8-ab09-6cf40f1e57ea req-79b260e1-6eeb-4da0-a214-17d1cc57e915 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 919.322841] env[65381]: INFO networking_nsxv3.common.synchronization [req-ff52ffda-65bf-4fb8-ab09-6cf40f1e57ea req-79b260e1-6eeb-4da0-a214-17d1cc57e915 service nova] Enqueued Resource ID: 6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 with Priority: HIGHEST for action port [ 919.325276] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 919.325276] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 919.325276] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 with Priority: HIGHEST for action port [ 919.325276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.325440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.325476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.325807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.325891] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.327031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.327031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.327031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.327273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.327273] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.327383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.327383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.327533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.328536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.328948] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.329523] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.329656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.329770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.331331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.331331] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e7bc9ba-30ae-441a-bff2-b9912cbd71c4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.710514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.710514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.710514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.710514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.733527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.733816] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.733933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.734015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.734216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.735019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.735019] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be updated. [ 919.768477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.768641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.771749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.771749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.771749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.782756] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: IN_PROGRESS for 2s [ 919.831492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.831686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.831839] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.832994] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 with status ACTIVE [ 919.832994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.833170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.833207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.833464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.833568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.833812] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.834075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.834075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.834075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.834260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.834397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.834397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.835156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.835156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.835156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.835156] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e7bc9ba-30ae-441a-bff2-b9912cbd71c4 is going to be updated. [ 919.864754] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.864893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.864958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.865188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.865328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.865486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e7bc9ba-30ae-441a-bff2-b9912cbd71c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.340437] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.843028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.843213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.843368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.843596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.843732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.843839] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be created. [ 920.873078] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.873391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.873984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.875487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.875487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.891438] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: UNINITIALIZED for 2s [ 920.897049] env[65381]: INFO networking_nsxv3.common.synchronization [None req-32e4a22b-f1b1-4c5d-8d85-3400bec32893 None None] Enqueued Resource ID: a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf with Priority: HIGHEST for action port [ 920.897806] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf with Priority: HIGHEST for action port [ 920.897979] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.898094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.898094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.898378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.898477] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.403437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf [ 921.403702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.403795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.403864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.404089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.404169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.404388] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf already deleted. [ 921.404388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5150e62-bdaa-49e3-9cc1-b72f55f2cfdf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.793322] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e in Status: SUCCESS [ 921.793528] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e deletion is rescheduled due to dependency. [ 921.793644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.902233] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 922.902528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.902693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.902951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.903193] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.903364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.903449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.903676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.903794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.903907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.904030] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.406650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.406650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.406650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.406650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.406880] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.406941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.406972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.407204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.407204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.407341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.407478] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.407578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.407630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.407781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.407922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.408215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.408215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.408291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.408291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.408504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.408504] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.910774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 923.934252] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.934457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.934505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.934722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.934790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.935042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.935146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.935209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.935366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.935442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.935614] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.935708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.935770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.935905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.935977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.936167] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.936258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.936319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.936460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.936531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.936616] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be created. [ 924.000433] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.000622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.000654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.000853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.001041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.019442] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 925.899078] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 925.899336] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 926.036033] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 926.036033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.195265] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a8570df2-c172-4b15-9e74-99e82b89f970 None None] Enqueued Resource ID: 580daadb-fab0-488f-a6f8-6389fa9a0340 with Priority: HIGHEST for action port [ 928.195747] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 580daadb-fab0-488f-a6f8-6389fa9a0340 with Priority: HIGHEST for action port [ 928.196065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-580daadb-fab0-488f-a6f8-6389fa9a0340 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.196257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-580daadb-fab0-488f-a6f8-6389fa9a0340" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.196257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-580daadb-fab0-488f-a6f8-6389fa9a0340" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.196542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-580daadb-fab0-488f-a6f8-6389fa9a0340" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.196627] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('580daadb-fab0-488f-a6f8-6389fa9a0340',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.702810] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 580daadb-fab0-488f-a6f8-6389fa9a0340 [ 928.702810] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.703131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.703206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.703544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.703782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.703945] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:580daadb-fab0-488f-a6f8-6389fa9a0340 already deleted. [ 928.704058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-580daadb-fab0-488f-a6f8-6389fa9a0340" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.288435] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c8fe6f7c-4c2d-442f-8391-fada46c6e1fb None None] Enqueued Resource ID: 0cbc2e34-e5f6-42f2-bce9-d136762da2f3 with Priority: HIGHEST for action port [ 930.289244] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cbc2e34-e5f6-42f2-bce9-d136762da2f3 with Priority: HIGHEST for action port [ 930.289396] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cbc2e34-e5f6-42f2-bce9-d136762da2f3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.289992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cbc2e34-e5f6-42f2-bce9-d136762da2f3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.289992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cbc2e34-e5f6-42f2-bce9-d136762da2f3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.290750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cbc2e34-e5f6-42f2-bce9-d136762da2f3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.290750] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbc2e34-e5f6-42f2-bce9-d136762da2f3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.596311] env[65381]: INFO networking_nsxv3.common.synchronization [req-c0a0fce7-d162-4e1d-9080-a4fc56b804a0 req-adb15560-43ce-4ca1-9118-3dcce2b45632 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 930.596721] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 930.596890] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.598286] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.598286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.598286] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.794615] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cbc2e34-e5f6-42f2-bce9-d136762da2f3 [ 930.794615] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.794934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.794934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.794992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.795156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.795256] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cbc2e34-e5f6-42f2-bce9-d136762da2f3 already deleted. [ 930.795311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cbc2e34-e5f6-42f2-bce9-d136762da2f3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.102953] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.102953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.102953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.102953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.138971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.139801] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.139801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.139801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.139801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.139801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.140484] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 931.177337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.177337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.177337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.177337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.177337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.191033] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.191033] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.191033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.191033] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.191033] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.191033] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.191033] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.192228] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.192228] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.192228] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.193096] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 931.214111] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.214111] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.214111] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.214111] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.214111] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-99ced7df-bd91-4a39-9787-48a4816fad4d taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.214111] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.214111] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.215795] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.216489] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ced7df-bd91-4a39-9787-48a4816fad4d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.720033] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.720033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.720488] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.720536] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.720745] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.721079] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 99ced7df-bd91-4a39-9787-48a4816fad4d not found, creating... [ 931.721233] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.721429] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.721583] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.721823] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.721965] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.722347] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.722519] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.722637] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.722910] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.723181] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.723251] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 99ced7df-bd91-4a39-9787-48a4816fad4d is going to be created. [ 931.745848] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.746094] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.746228] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.746524] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.746765] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.747039] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.433076] env[65381]: INFO networking_nsxv3.common.synchronization [req-c0a0fce7-d162-4e1d-9080-a4fc56b804a0 req-ff94baea-11a6-46eb-9af6-98fdb78f00e9 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 932.433455] env[65381]: INFO networking_nsxv3.common.synchronization [req-c0a0fce7-d162-4e1d-9080-a4fc56b804a0 req-ff94baea-11a6-46eb-9af6-98fdb78f00e9 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 932.433455] env[65381]: INFO networking_nsxv3.common.synchronization [req-c0a0fce7-d162-4e1d-9080-a4fc56b804a0 req-ff94baea-11a6-46eb-9af6-98fdb78f00e9 service nova] Enqueued Resource ID: 99ced7df-bd91-4a39-9787-48a4816fad4d with Priority: HIGHEST for action port [ 932.433980] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 932.434463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 932.434463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99ced7df-bd91-4a39-9787-48a4816fad4d with Priority: HIGHEST for action port [ 932.434820] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.434820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.434820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.435052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.435052] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.435833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.435952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.436164] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-99ced7df-bd91-4a39-9787-48a4816fad4d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.436313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.436313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.436603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.436603] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99ced7df-bd91-4a39-9787-48a4816fad4d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.938587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.939307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.940389] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99ced7df-bd91-4a39-9787-48a4816fad4d with status ACTIVE [ 932.944201] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.944638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.944638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.944914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.944914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.945060] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.945153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.945211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.945373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.945758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.945835] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.945938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.945938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.946166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.946166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.946252] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99ced7df-bd91-4a39-9787-48a4816fad4d is going to be updated. [ 932.973650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.973797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.973868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.974096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.974234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.974434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99ced7df-bd91-4a39-9787-48a4816fad4d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.220562] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 933.221061] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 933.221061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.221407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.221407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.221587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.221587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.221708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.221759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.221844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.221939] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.724748] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.021606] env[65381]: INFO networking_nsxv3.common.synchronization [None req-d558fbdf-ee00-4d47-8568-8ca1eecfa43c None None] Enqueued Resource ID: aa966fe1-5748-400e-b476-ccff6c9cfb82 with Priority: HIGHEST for action port [ 934.022120] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa966fe1-5748-400e-b476-ccff6c9cfb82 with Priority: HIGHEST for action port [ 934.022509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa966fe1-5748-400e-b476-ccff6c9cfb82 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.022636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa966fe1-5748-400e-b476-ccff6c9cfb82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.022703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa966fe1-5748-400e-b476-ccff6c9cfb82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.023303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa966fe1-5748-400e-b476-ccff6c9cfb82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.023843] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa966fe1-5748-400e-b476-ccff6c9cfb82',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.227420] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.528838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa966fe1-5748-400e-b476-ccff6c9cfb82 [ 934.528838] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.530145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.530145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.530145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.530145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.530145] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa966fe1-5748-400e-b476-ccff6c9cfb82 already deleted. [ 934.530145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa966fe1-5748-400e-b476-ccff6c9cfb82" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.730427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.730611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.730677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.730941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.731074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.731179] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 934.774120] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.774120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.774120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.776874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.776874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.790651] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 936.808088] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 936.808088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.808088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.808484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.808484] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.808611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.808611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.808751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.808804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.808895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.809819] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.812853] env[65381]: INFO networking_nsxv3.common.synchronization [None req-7c0e9818-2130-4955-9ef5-40b41b297985 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_rules [ 936.813789] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_rules [ 936.816122] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.816270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.816318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.816609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.816689] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.905220] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6f13cf1f-d5e2-47be-9f3e-8ebf5ea7854f None None] Enqueued Resource ID: 1fdc6498-596c-4084-8947-ec1a4f213851 with Priority: HIGHEST for action port [ 936.905860] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fdc6498-596c-4084-8947-ec1a4f213851 with Priority: HIGHEST for action port [ 936.906411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fdc6498-596c-4084-8947-ec1a4f213851 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.906539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fdc6498-596c-4084-8947-ec1a4f213851" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.906609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fdc6498-596c-4084-8947-ec1a4f213851" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.907792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fdc6498-596c-4084-8947-ec1a4f213851" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.907792] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fdc6498-596c-4084-8947-ec1a4f213851',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.027522] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1ef348ce-beb1-4a34-8aba-688ed5f86def tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_rules [ 937.029462] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_rules [ 937.029462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.029462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.314790] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.315016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.315092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.315319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.315493] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.315602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.315688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.315814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.315901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.315985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.316405] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.316405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.316405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.316579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.316630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.316708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.316763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.316924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.317038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.317174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.317335] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.344935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.344935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.344935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.344935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.344935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.344935] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 already deleted. [ 937.344935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.345342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.345342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.345342] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.412907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fdc6498-596c-4084-8947-ec1a4f213851 [ 937.412907] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.412907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.412907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.412907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.412907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.412907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fdc6498-596c-4084-8947-ec1a4f213851 already deleted. [ 937.412907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fdc6498-596c-4084-8947-ec1a4f213851" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.700925] env[65381]: INFO networking_nsxv3.common.synchronization [req-ae6a45c0-73a5-485b-98b9-bf54e3101624 req-e614f0aa-ddbc-438f-b7ba-3d676ce09b32 tempest-ListServersNegativeTestJSON-693739231 tempest-ListServersNegativeTestJSON-693739231-project-member] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 937.701698] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 937.702642] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.702833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.702940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.703259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.703559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.703656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.703755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.703999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.704146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.704623] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.754249] env[65381]: INFO networking_nsxv3.common.synchronization [req-5fc0b0f9-1a34-4380-b471-db412d1921e2 req-aa35cce3-cdd2-428c-afb2-eae304cb9994 tempest-ListServersNegativeTestJSON-693739231 tempest-ListServersNegativeTestJSON-693739231-project-member] Enqueued Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 937.754993] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad with Priority: HIGHEST for action security_group_members [ 937.755472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5819134c-7e49-4e7e-b983-fb61c5b540ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.755641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.819740] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a23f96-505a-4b63-87f3-5175bacc51ab: rpc.has_security_group_logging(os_id): False [ 937.839206] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.839402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.839511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.839765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.839910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.840223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.840363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.840432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.840619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.840691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.840922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.841064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.841161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.841336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.841423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.841641] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.841738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.841822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.841995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.842183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.842288] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 937.866094] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.866094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.866302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.866403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.866446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.866618] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 already deleted. [ 937.866618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.919937] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.923144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.923144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.923144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.923144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.938245] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 938.209434] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.712345] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.215476] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.215849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.215849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.217063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.217063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.217063] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 939.249031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.249453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.249547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.249910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.249910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.261038] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 939.956604] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 939.956604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.277712] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 941.278026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.278117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.278334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.278524] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.278643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.278708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.278862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.278944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.279052] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5819134c-7e49-4e7e-b983-fb61c5b540ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.782043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.786019] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.786019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.786019] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad is going to be updated. [ 941.815063] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.815063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.815063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.815063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.815063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.822786] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: IN_PROGRESS for 2s [ 942.590431] env[65381]: INFO networking_nsxv3.common.synchronization [req-16bb6bb3-84db-4d3d-bb04-5c9d3e52905b req-b5f84ef1-8732-4db3-a4d4-9c81858ceaa1 tempest-FloatingIPsAssociationTestJSON-1528714218 tempest-FloatingIPsAssociationTestJSON-1528714218-project-member] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 942.591332] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 942.591332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.591484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.591566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.591738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.592279] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.592279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.592279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.592279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.592423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.592423] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.774265] env[65381]: INFO networking_nsxv3.common.synchronization [None req-901f8ce3-04e3-444d-af51-9610a2e49330 None None] Enqueued Resource ID: 3818ff06-b641-4e68-83f2-41df626a2bc6 with Priority: HIGHEST for action port [ 942.774265] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3818ff06-b641-4e68-83f2-41df626a2bc6 with Priority: HIGHEST for action port [ 942.774265] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3818ff06-b641-4e68-83f2-41df626a2bc6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.774265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3818ff06-b641-4e68-83f2-41df626a2bc6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.774265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3818ff06-b641-4e68-83f2-41df626a2bc6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.774265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3818ff06-b641-4e68-83f2-41df626a2bc6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.776101] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3818ff06-b641-4e68-83f2-41df626a2bc6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.054023] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.054023] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.054023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.054023] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.054023] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.054023] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.054787] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.055061] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.055316] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.055596] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.077252] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.077413] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.077536] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.077701] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-548" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.078034] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-f300e099-01f0-4de1-8425-ab8559c0ed6b taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.078229] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.078301] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.078621] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.078758] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f300e099-01f0-4de1-8425-ab8559c0ed6b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.094479] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.280929] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3818ff06-b641-4e68-83f2-41df626a2bc6 [ 943.281267] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.284043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.284043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.284043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.284043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.284043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3818ff06-b641-4e68-83f2-41df626a2bc6 already deleted. [ 943.284043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3818ff06-b641-4e68-83f2-41df626a2bc6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.582656] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.582656] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.582656] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.582656] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.582656] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.582656] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port f300e099-01f0-4de1-8425-ab8559c0ed6b not found, creating... [ 943.582882] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.582998] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.583125] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.583435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.583489] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.583782] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.583930] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.585208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.585208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.585208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.585208] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: f300e099-01f0-4de1-8425-ab8559c0ed6b is going to be created. [ 943.599026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.610260] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.610475] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.610599] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.610858] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.611089] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.611316] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.851272] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad in Status: SUCCESS [ 943.851504] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5819134c-7e49-4e7e-b983-fb61c5b540ad deletion is rescheduled due to dependency. [ 943.851629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5819134c-7e49-4e7e-b983-fb61c5b540ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.103231] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.103231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.103231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.103427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.104131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.104131] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be updated. [ 944.144030] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.144030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.144030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.144204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.144631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.157690] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: IN_PROGRESS for 2s [ 944.370723] env[65381]: INFO networking_nsxv3.common.synchronization [req-16bb6bb3-84db-4d3d-bb04-5c9d3e52905b req-477c7c3b-ad85-41f2-9578-684411ea0ebd service nova] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_rules [ 944.370922] env[65381]: INFO networking_nsxv3.common.synchronization [req-16bb6bb3-84db-4d3d-bb04-5c9d3e52905b req-477c7c3b-ad85-41f2-9578-684411ea0ebd service nova] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 944.371086] env[65381]: INFO networking_nsxv3.common.synchronization [req-16bb6bb3-84db-4d3d-bb04-5c9d3e52905b req-477c7c3b-ad85-41f2-9578-684411ea0ebd service nova] Enqueued Resource ID: f300e099-01f0-4de1-8425-ab8559c0ed6b with Priority: HIGHEST for action port [ 944.371725] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_rules [ 944.371931] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 944.373418] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f300e099-01f0-4de1-8425-ab8559c0ed6b with Priority: HIGHEST for action port [ 944.373847] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.377026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.377026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.377026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f300e099-01f0-4de1-8425-ab8559c0ed6b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.377026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.377026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f300e099-01f0-4de1-8425-ab8559c0ed6b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.880461] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f300e099-01f0-4de1-8425-ab8559c0ed6b with status ACTIVE [ 944.880756] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.880913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.880980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.881958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.881958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.882659] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.882659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.882659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.883202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.883202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.886218] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.886414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.886523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.886783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.886896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.888428] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f300e099-01f0-4de1-8425-ab8559c0ed6b is going to be updated. [ 944.888509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.888598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.962913] env[65381]: INFO networking_nsxv3.common.synchronization [None req-af324825-b981-4868-b540-926d8efea76a None None] Enqueued Resource ID: 0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f with Priority: HIGHEST for action port [ 944.963599] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.964127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.964327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.964735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.965076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.965373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f300e099-01f0-4de1-8425-ab8559c0ed6b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.966336] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f with Priority: HIGHEST for action port [ 944.967513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.967513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.967513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.967513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.967513] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.472434] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f [ 945.472745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.472890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.472963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.473211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.473318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.473416] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f already deleted. [ 945.473591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aed38d5-5cf8-4ed0-befe-9ddd6f143c8f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.187926] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 946.187926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.189202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.189202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.189202] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.189202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.189546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.189546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.189546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.189546] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.693446] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.199022] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.700180] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.700337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.700407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.700687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.700778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.700880] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be updated. [ 947.736023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.736023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.736023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.736023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.736023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.747886] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: IN_PROGRESS for 2s [ 948.506211] env[65381]: INFO networking_nsxv3.common.synchronization [req-2a777f2e-0548-45dc-a344-c660bac7ed66 req-8fa27665-b6d0-4f8d-8493-e1f79bbbed0f tempest-InstanceActionsNegativeTestJSON-1119724909 tempest-InstanceActionsNegativeTestJSON-1119724909-project-member] Enqueued Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_members [ 948.506211] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_members [ 948.506211] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.508092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.508448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.508961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.509289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.509425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.509502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.509686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.509820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.509977] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.966790] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.967056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-166" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.969243] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-166" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.969741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-166" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.970115] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.970307] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.970484] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.970665] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.970882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.971361] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.971361] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.971455] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.971506] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.971641] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.971750] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.971881] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.997211] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.997211] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.997211] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.997211] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-166" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.997384] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-f2e238b4-19d0-4030-bdd0-33410e482643 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.997558] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.998212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.998212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.998372] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2e238b4-19d0-4030-bdd0-33410e482643',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.013131] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.013429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.013641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.013950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.014251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.014510] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.014898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.015170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.015321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.015479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.015816] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b already deleted. [ 949.015979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.502747] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.502989] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.503397] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.503800] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.503916] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.504223] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port f2e238b4-19d0-4030-bdd0-33410e482643 not found, creating... [ 949.505043] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.505043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.505212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.505484] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.505735] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.506196] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.506483] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.506742] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.506979] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.507161] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.507379] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: f2e238b4-19d0-4030-bdd0-33410e482643 is going to be created. [ 949.536784] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.537201] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.537390] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.537600] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.537833] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.538078] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.761321] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 949.761723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.762049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.762236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.762488] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.762628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.762820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.762911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.763021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.763156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.764729] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.242869] env[65381]: INFO networking_nsxv3.common.synchronization [req-2a777f2e-0548-45dc-a344-c660bac7ed66 req-5a0a92a1-4cca-47b5-a8dd-d7601b485fb6 service nova] Enqueued Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_rules [ 950.243139] env[65381]: INFO networking_nsxv3.common.synchronization [req-2a777f2e-0548-45dc-a344-c660bac7ed66 req-5a0a92a1-4cca-47b5-a8dd-d7601b485fb6 service nova] Enqueued Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_members [ 950.243873] env[65381]: INFO networking_nsxv3.common.synchronization [req-2a777f2e-0548-45dc-a344-c660bac7ed66 req-5a0a92a1-4cca-47b5-a8dd-d7601b485fb6 service nova] Enqueued Resource ID: f2e238b4-19d0-4030-bdd0-33410e482643 with Priority: HIGHEST for action port [ 950.243873] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_rules [ 950.244014] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_members [ 950.244014] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e238b4-19d0-4030-bdd0-33410e482643 with Priority: HIGHEST for action port [ 950.244984] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.244984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.244984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.244984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.244984] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.245830] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.245830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.245830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.245994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.246135] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.246219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.246291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.250514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.250514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.250514] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.252670] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2e238b4-19d0-4030-bdd0-33410e482643 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.252841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.252913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.253126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.253207] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2e238b4-19d0-4030-bdd0-33410e482643',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.266410] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.266572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.266617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.266824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.266975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.267092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.267156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.267299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.267384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.267468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.267653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.267712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.267747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.267881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.268027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.268123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.268194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.268310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.268384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.268463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.268552] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.755857] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.756945] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.757077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.757256] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2e238b4-19d0-4030-bdd0-33410e482643 with status ACTIVE [ 950.757420] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.757545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.757615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.757925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.758042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.758223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.758326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.758388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.758553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.758634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.758818] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.758985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.758985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.759136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.759210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.759297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2e238b4-19d0-4030-bdd0-33410e482643 is going to be updated. [ 950.771349] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c007b86e-f555-43b0-9e5a-60b1b4faffb3: rpc.has_security_group_logging(os_id): False [ 950.789867] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.790085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.790183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.790447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.790616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.790833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2e238b4-19d0-4030-bdd0-33410e482643" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.791991] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.792174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.792252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.792470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.792561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.792773] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.792889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.792976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.793155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.793254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.793492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.793624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.793704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.793856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.793943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.794182] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.794312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.794398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.794576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.794658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.794745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be updated. [ 950.862043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.862043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.862043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.862043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.862043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.881125] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: IN_PROGRESS for 2s [ 951.187631] env[65381]: INFO networking_nsxv3.common.synchronization [req-d3cc321c-04d9-4ec7-959f-0eaad956f1a0 req-461f8e5c-025e-45b4-864f-33fe29bff440 tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 951.188333] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 951.188730] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.188830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.188933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.189164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.189653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.189653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.189653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.189820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.189913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.190022] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.261643] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.571748] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.571967] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.572159] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.572428] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.572718] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.573771] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.574792] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.574792] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.574792] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.574792] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.575042] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.575042] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.575123] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.575176] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.575326] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.575524] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.596652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.596823] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.596931] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.597137] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-179" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.597527] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-9911b626-f970-45ef-a658-95f5e999106a taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.597709] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.597828] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.598174] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.598314] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9911b626-f970-45ef-a658-95f5e999106a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.693187] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.693187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.693187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.693187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.693187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.693382] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.693429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.693482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.693713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.693791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.693880] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 951.722495] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.722679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.722752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.722971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.723147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.735652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 951.764209] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.764537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.764537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.764685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.764816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.764941] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b is going to be created. [ 951.810225] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.810436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.810436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.810685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.810874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.824987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b in Status: UNINITIALIZED for 2s [ 952.102058] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.102284] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.102413] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.102706] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.102853] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.103010] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 9911b626-f970-45ef-a658-95f5e999106a not found, creating... [ 952.103301] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.103463] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.103618] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.103847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.103981] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.104275] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.104431] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.104570] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.104811] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.104945] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.105489] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 9911b626-f970-45ef-a658-95f5e999106a is going to be created. [ 952.127500] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.127775] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.127828] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.128186] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.128526] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.128776] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.764779] env[65381]: INFO networking_nsxv3.common.synchronization [None req-d6eb676e-7cf3-43e5-a053-ed7e6ee50ed0 None None] Enqueued Resource ID: 473f761b-7d70-40e1-860a-f80b226101a3 with Priority: HIGHEST for action port [ 952.765735] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473f761b-7d70-40e1-860a-f80b226101a3 with Priority: HIGHEST for action port [ 952.765735] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-473f761b-7d70-40e1-860a-f80b226101a3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.765912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-473f761b-7d70-40e1-860a-f80b226101a3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.765984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-473f761b-7d70-40e1-860a-f80b226101a3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.766665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-473f761b-7d70-40e1-860a-f80b226101a3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.766756] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473f761b-7d70-40e1-860a-f80b226101a3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.870156] env[65381]: INFO networking_nsxv3.common.synchronization [req-d3cc321c-04d9-4ec7-959f-0eaad956f1a0 req-4d845b37-ea20-47fa-9766-4981ac9e542d service nova] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_rules [ 952.870421] env[65381]: INFO networking_nsxv3.common.synchronization [req-d3cc321c-04d9-4ec7-959f-0eaad956f1a0 req-4d845b37-ea20-47fa-9766-4981ac9e542d service nova] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 952.870602] env[65381]: INFO networking_nsxv3.common.synchronization [req-d3cc321c-04d9-4ec7-959f-0eaad956f1a0 req-4d845b37-ea20-47fa-9766-4981ac9e542d service nova] Enqueued Resource ID: 9911b626-f970-45ef-a658-95f5e999106a with Priority: HIGHEST for action port [ 952.871359] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_rules [ 952.872291] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 952.872291] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9911b626-f970-45ef-a658-95f5e999106a with Priority: HIGHEST for action port [ 952.872291] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.872291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.872291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.872592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.872592] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.873846] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.873969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.874260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-9911b626-f970-45ef-a658-95f5e999106a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.874373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.874456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.874674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.874813] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9911b626-f970-45ef-a658-95f5e999106a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.900429] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 952.900429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.270713] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 473f761b-7d70-40e1-860a-f80b226101a3 [ 953.271263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.271707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.271771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.272174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.272359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.272604] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:473f761b-7d70-40e1-860a-f80b226101a3 already deleted. [ 953.272758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-473f761b-7d70-40e1-860a-f80b226101a3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.377311] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.377506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.377745] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9911b626-f970-45ef-a658-95f5e999106a with status ACTIVE [ 953.378093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.378264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.378360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.378695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.378859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.379134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.379269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.379359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.379582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.379693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.379948] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.380125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.380237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.380459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.380580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.380695] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9911b626-f970-45ef-a658-95f5e999106a is going to be updated. [ 953.411462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.411631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.411699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.411922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.412080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.412237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9911b626-f970-45ef-a658-95f5e999106a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.747705] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 953.747908] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb deletion is rescheduled due to dependency. [ 953.747998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.750334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.750334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.750334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.750334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.750334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.750334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.750334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.750334] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.816749] env[65381]: INFO networking_nsxv3.common.synchronization [req-7156dd0c-0e62-455f-9824-567478977608 req-ffa095f8-0bfe-4749-8182-ce6064fd6cae tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 953.817423] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 953.817705] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.817838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.817908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.818198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.818365] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.818471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.818569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.818738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.818827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.818962] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.836757] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b in Status: SUCCESS [ 953.837950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.838533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.838533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.839202] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.839329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.839371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.839665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.839730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.840167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.840266] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.252321] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.279651] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.279651] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.279651] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.279913] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.280038] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.280198] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.280309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.280531] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.280662] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.280868] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.280972] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.281087] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.281188] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.281323] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.281383] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.281901] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.304711] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.305136] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.305326] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.305527] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.306223] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-c718385b-7364-4e4c-bef7-3a4240cbbef1 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.306542] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.306859] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.307335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.307560] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c718385b-7364-4e4c-bef7-3a4240cbbef1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.321233] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.321722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.321844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.322163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.322329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.322604] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.322791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.322902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.323234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.323310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.323435] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 already deleted. [ 954.323607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.343078] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.343235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.343349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.343654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.343811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.343924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.343990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.344170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.344256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.344346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.344497] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.344593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.344701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.344864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.345014] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.345111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.345171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.345543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.345647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.345722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.345815] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.755471] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.814495] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.814798] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.814933] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.815272] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.815431] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.815603] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port c718385b-7364-4e4c-bef7-3a4240cbbef1 not found, creating... [ 954.815925] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.816142] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.816276] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.816522] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.816711] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.817068] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.817315] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.817377] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.817609] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.817759] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.817920] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: c718385b-7364-4e4c-bef7-3a4240cbbef1 is going to be created. [ 954.844013] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.844013] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.844190] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.844430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.845366] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.845366] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.848269] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b: rpc.has_security_group_logging(os_id): False [ 954.869447] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.869925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.869925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.870039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.870151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.870356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.870504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.870654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.870786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.870978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.871143] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.871237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.871332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.872141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.872141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.872141] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.872141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.872141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.872301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.872329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.872475] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b is going to be created. [ 954.947279] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.947763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.947763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.947763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.947932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.979726] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b in Status: IN_PROGRESS for 2s [ 955.258708] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.258976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.258976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.259565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.259565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.259565] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 955.295939] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.296199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.296199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.296391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.296495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.310907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 955.593715] env[65381]: INFO networking_nsxv3.common.synchronization [req-7156dd0c-0e62-455f-9824-567478977608 req-b6893b96-79f2-4ed0-812d-f25ce7c83baa service nova] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_rules [ 955.593867] env[65381]: INFO networking_nsxv3.common.synchronization [req-7156dd0c-0e62-455f-9824-567478977608 req-b6893b96-79f2-4ed0-812d-f25ce7c83baa service nova] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 955.593995] env[65381]: INFO networking_nsxv3.common.synchronization [req-7156dd0c-0e62-455f-9824-567478977608 req-b6893b96-79f2-4ed0-812d-f25ce7c83baa service nova] Enqueued Resource ID: c718385b-7364-4e4c-bef7-3a4240cbbef1 with Priority: HIGHEST for action port [ 955.594541] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_rules [ 955.594700] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 955.594989] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c718385b-7364-4e4c-bef7-3a4240cbbef1 with Priority: HIGHEST for action port [ 955.598097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.598097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.598097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.598097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.598251] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.603301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.603427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.603494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.605111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.605111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.605111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.605111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.605111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.605111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.605111] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.605567] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c718385b-7364-4e4c-bef7-3a4240cbbef1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.605567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.605662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.605771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.605847] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c718385b-7364-4e4c-bef7-3a4240cbbef1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.613498] env[65381]: INFO networking_nsxv3.common.synchronization [None req-7f47f780-d665-4f76-a942-727e41c9c3fe None None] Enqueued Resource ID: a5bdf02c-3050-4a96-a06e-4a2d3fc5f108 with Priority: HIGHEST for action port [ 955.613671] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5bdf02c-3050-4a96-a06e-4a2d3fc5f108 with Priority: HIGHEST for action port [ 955.614456] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5bdf02c-3050-4a96-a06e-4a2d3fc5f108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.614456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5bdf02c-3050-4a96-a06e-4a2d3fc5f108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.614456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5bdf02c-3050-4a96-a06e-4a2d3fc5f108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.614456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5bdf02c-3050-4a96-a06e-4a2d3fc5f108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.614974] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5bdf02c-3050-4a96-a06e-4a2d3fc5f108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.108276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.108634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.108634] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.113492] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c718385b-7364-4e4c-bef7-3a4240cbbef1 with status ACTIVE [ 956.113864] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.114018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.114106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.114342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.114441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.114688] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.114795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.114859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.115028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.115109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.115293] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.115389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.115452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.115595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.115670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.115755] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c718385b-7364-4e4c-bef7-3a4240cbbef1 is going to be updated. [ 956.117382] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5bdf02c-3050-4a96-a06e-4a2d3fc5f108 [ 956.117539] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.117642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.117746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.117861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.117934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.118042] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5bdf02c-3050-4a96-a06e-4a2d3fc5f108 already deleted. [ 956.118127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5bdf02c-3050-4a96-a06e-4a2d3fc5f108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.139121] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.139374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.139374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.139485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.139616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.139782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c718385b-7364-4e4c-bef7-3a4240cbbef1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.400617] env[65381]: INFO networking_nsxv3.common.synchronization [req-b626d723-f610-4949-87ed-010f11e316ea req-5bdb6e80-f827-4217-82a4-4620f43406be tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 956.401503] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 956.401948] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.402083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.611735] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.815130] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.815926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.815926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.815926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.816229] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.816428] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.816554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.816840] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.816990] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.817271] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.817390] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.817498] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.817602] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.817713] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.817831] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.818027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.842955] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.843108] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.843252] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.844089] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.845610] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-3dc57972-e570-4d7a-8313-7cbc793d0112 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.845610] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.845610] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.845610] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.845610] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc57972-e570-4d7a-8313-7cbc793d0112',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.993575] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b in Status: SUCCESS [ 956.993575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.120523] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.120523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.120523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.120523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.120523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.120523] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be created. [ 957.157153] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.157353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.157404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.157629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.157806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.173119] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: UNINITIALIZED for 2s [ 957.334153] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 957.334379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.335766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.335766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.335766] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.349222] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.349488] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.349597] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.349870] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.350098] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.350526] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 3dc57972-e570-4d7a-8313-7cbc793d0112 not found, creating... [ 957.350712] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.350890] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.351008] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.351335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.351465] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.351778] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.351923] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.352534] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.352697] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.352843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.352984] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 3dc57972-e570-4d7a-8313-7cbc793d0112 is going to be created. [ 957.387685] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.387996] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.388261] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.388583] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.388873] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.389341] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.840045] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.840045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.840045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.840286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.840531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.840721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.840827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.841107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.841307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.841389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.841668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.841819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.841916] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.842261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.842480] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.842616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.842707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.842921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.843831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.843831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.843831] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.111206] env[65381]: INFO networking_nsxv3.common.synchronization [req-b626d723-f610-4949-87ed-010f11e316ea req-49b840d1-4c47-4fd1-865c-37ccc45ad687 service nova] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_rules [ 958.111206] env[65381]: INFO networking_nsxv3.common.synchronization [req-b626d723-f610-4949-87ed-010f11e316ea req-49b840d1-4c47-4fd1-865c-37ccc45ad687 service nova] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 958.111206] env[65381]: INFO networking_nsxv3.common.synchronization [req-b626d723-f610-4949-87ed-010f11e316ea req-49b840d1-4c47-4fd1-865c-37ccc45ad687 service nova] Enqueued Resource ID: 3dc57972-e570-4d7a-8313-7cbc793d0112 with Priority: HIGHEST for action port [ 958.111904] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_rules [ 958.112264] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 958.112735] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dc57972-e570-4d7a-8313-7cbc793d0112 with Priority: HIGHEST for action port [ 958.113390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.113688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.114076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.114296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.114680] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dc57972-e570-4d7a-8313-7cbc793d0112 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.114982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.115198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.115583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.115801] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dc57972-e570-4d7a-8313-7cbc793d0112',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.346426] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb: rpc.has_security_group_logging(os_id): False [ 958.367727] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.368195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.368195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.368195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.368317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.368462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.368565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.368629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.368781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.369146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.369146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.369247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.369247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.369359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.369432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.369618] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.369713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.369774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.370010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.370010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.370171] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 958.467937] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.467937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.468270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.468270] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.468369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.487866] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 958.619353] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dc57972-e570-4d7a-8313-7cbc793d0112 with status ACTIVE [ 958.619709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.619909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.620064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.620471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.620530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.620833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.620943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.621061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.621288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.621399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.621760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.621882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.621949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.624989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.624989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.624989] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dc57972-e570-4d7a-8313-7cbc793d0112 is going to be updated. [ 958.654648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.654648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.654648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.654953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.654953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.656526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dc57972-e570-4d7a-8313-7cbc793d0112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.045911] env[65381]: INFO networking_nsxv3.common.synchronization [req-a7d812ff-a531-4652-bdf9-912d64f3c6a4 req-1e862db3-44b0-49ef-97dd-4d6424d27805 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 959.048795] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 959.049083] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.049219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.050593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.050791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.050961] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.051087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.051146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.051305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.051387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.051482] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.185789] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 959.185789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.185989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.186128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.186355] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.186453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.186645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.186645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.186755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.186816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.186912] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.187706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.187872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.188033] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.188231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.188276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.188414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.188494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.188585] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.468826] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.470118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.470118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.470118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.470118] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.470118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.470118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.475585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.476008] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.476389] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.476592] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.476793] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.477126] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.477205] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.477383] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.477700] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.499615] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.499712] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.499973] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.500080] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.500346] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-b0043141-03fc-491d-85dc-b19445833873 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.500521] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.500635] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.500963] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.501551] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0043141-03fc-491d-85dc-b19445833873',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.553755] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.692616] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.692616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.692616] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.004661] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.004934] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.005259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.005871] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.005871] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.006061] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port b0043141-03fc-491d-85dc-b19445833873 not found, creating... [ 960.006234] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.006399] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.006515] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.006787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.007045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.007474] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.007709] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.007899] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.008265] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.008501] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.008752] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: b0043141-03fc-491d-85dc-b19445833873 is going to be created. [ 960.030973] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.031277] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.031480] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.031894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.032252] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.032678] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.056089] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.194046] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.508089] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 960.508434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.558603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.558856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.558985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.559836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.559836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.559836] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 960.602571] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.602810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.602810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.603010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.603267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.614989] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 960.696909] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.697074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.697148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.697371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.697460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.697566] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be updated. [ 960.725174] env[65381]: INFO networking_nsxv3.common.synchronization [req-59c6c4b3-6055-4096-923f-a46b7817cb75 req-e33e39d0-7f33-4926-8c00-4cb54998f9db tempest-ServersTestBootFromVolume-545680696 tempest-ServersTestBootFromVolume-545680696-project-member] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_members [ 960.725939] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGHEST for action security_group_members [ 960.726566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.726727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.726799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.727063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.727252] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.727377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.727437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.727606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.727716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.727864] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.738834] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.739088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.739169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.739415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.739633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.761874] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 960.766160] env[65381]: INFO networking_nsxv3.common.synchronization [req-a7d812ff-a531-4652-bdf9-912d64f3c6a4 req-dc52279b-7fbd-434f-ab6b-1100d940b472 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 960.766160] env[65381]: INFO networking_nsxv3.common.synchronization [req-a7d812ff-a531-4652-bdf9-912d64f3c6a4 req-dc52279b-7fbd-434f-ab6b-1100d940b472 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 960.766422] env[65381]: INFO networking_nsxv3.common.synchronization [req-a7d812ff-a531-4652-bdf9-912d64f3c6a4 req-dc52279b-7fbd-434f-ab6b-1100d940b472 service nova] Enqueued Resource ID: b0043141-03fc-491d-85dc-b19445833873 with Priority: HIGHEST for action port [ 960.767373] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 960.767373] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 960.767373] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0043141-03fc-491d-85dc-b19445833873 with Priority: HIGHEST for action port [ 960.767812] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.768022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.768390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.768390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.768485] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.770340] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.770518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.770825] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0043141-03fc-491d-85dc-b19445833873 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.771043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.771120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.771317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.771664] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0043141-03fc-491d-85dc-b19445833873',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.231618] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.231618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.231618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.234030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.266097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.266097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.266097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.266097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.266097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.266097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.266097] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 is going to be updated. [ 961.270433] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.270855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.276797] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0043141-03fc-491d-85dc-b19445833873 with status ACTIVE [ 961.276797] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.276797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.276797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.276797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.276797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.277417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.277417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.277417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.277417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.277417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.277668] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.277742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.277792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.277938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.278042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.278177] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0043141-03fc-491d-85dc-b19445833873 is going to be updated. [ 961.362021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.362021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.362021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.362021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.362021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.362021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0043141-03fc-491d-85dc-b19445833873" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.385443] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.385443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.385714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.385714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.385817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.410145] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 in Status: IN_PROGRESS for 2s [ 961.850031] env[65381]: INFO networking_nsxv3.common.synchronization [req-d554aa2f-c636-4895-b11e-869eb17c2c37 req-bf17a146-5401-41c3-b3b0-4e1ee2cb1783 tempest-FloatingIPsAssociationNegativeTestJSON-797311109 tempest-FloatingIPsAssociationNegativeTestJSON-797311109-project-member] Enqueued Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_members [ 961.850031] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_members [ 961.850031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.850031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.850031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.850031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.850031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.850031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.850031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.851191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.851490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.851794] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.355415] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.355705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.357606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.357606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.357606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.357606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.357606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.357606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.357917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.357917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.357917] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 already deleted. [ 962.358023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.366361] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-369 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.366361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-369" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.366361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-369" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.366361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-369" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.366361] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.366361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.366361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.366361] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.367093] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.367093] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.367093] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.367226] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.369255] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.369255] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.369255] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.376132] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.403027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.403027] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.403027] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.403027] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-369" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.403027] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-907677b7-7720-4fe4-8e60-8c7af60c69da taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.407342] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.407550] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.408054] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.408293] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907677b7-7720-4fe4-8e60-8c7af60c69da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.700444] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.700444] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.700444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.700444] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.778437] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 962.778803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.778905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.779125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.779319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.779446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.779512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.779728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.779807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.779933] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.911902] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.912542] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.912694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.913043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.913309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.913643] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 907677b7-7720-4fe4-8e60-8c7af60c69da not found, creating... [ 962.914106] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.915818] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.915818] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.915818] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.915818] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.915818] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.916270] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.916345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.916729] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.916964] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.917239] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 907677b7-7720-4fe4-8e60-8c7af60c69da is going to be created. [ 962.943251] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.943554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.943717] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.944043] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.944286] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.944771] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.139150] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.282968] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.425281] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 in Status: SUCCESS [ 963.425281] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 deletion is rescheduled due to dependency. [ 963.425281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.643232] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.678451] env[65381]: INFO networking_nsxv3.common.synchronization [req-d554aa2f-c636-4895-b11e-869eb17c2c37 req-b1840594-3de0-4370-9024-0dd174680543 service nova] Enqueued Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_rules [ 963.678676] env[65381]: INFO networking_nsxv3.common.synchronization [req-d554aa2f-c636-4895-b11e-869eb17c2c37 req-b1840594-3de0-4370-9024-0dd174680543 service nova] Enqueued Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_members [ 963.678676] env[65381]: INFO networking_nsxv3.common.synchronization [req-d554aa2f-c636-4895-b11e-869eb17c2c37 req-b1840594-3de0-4370-9024-0dd174680543 service nova] Enqueued Resource ID: 907677b7-7720-4fe4-8e60-8c7af60c69da with Priority: HIGHEST for action port [ 963.680290] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_rules [ 963.680438] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_members [ 963.680537] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907677b7-7720-4fe4-8e60-8c7af60c69da with Priority: HIGHEST for action port [ 963.680847] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.681300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.681370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.681655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.681728] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.682813] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.682936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.687107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.687107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.687107] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.687357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.687357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.687416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.687451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.687614] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.690667] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-907677b7-7720-4fe4-8e60-8c7af60c69da taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.690796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.690866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.691254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.691254] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907677b7-7720-4fe4-8e60-8c7af60c69da',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.786194] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.147998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.148451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.148451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.148451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.148576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.148651] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 964.150915] env[65381]: INFO networking_nsxv3.common.synchronization [req-a91977d2-2ae2-4ead-805f-25c337ade05c req-d0166051-1f30-4254-b8bd-e0dd71a10842 tempest-ServersTestJSON-345764332 tempest-ServersTestJSON-345764332-project-member] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_members [ 964.152100] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGHEST for action security_group_members [ 964.152502] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.152653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.152724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.152946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.153111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.153225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.153287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.153408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.153490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.153698] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.186726] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.187089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.187267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.187500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.187690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.191457] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.193036] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 907677b7-7720-4fe4-8e60-8c7af60c69da with status ACTIVE [ 964.193246] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.194402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.194402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.194402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.194402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.194402] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.194402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.194402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.195168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.195168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.195168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.195168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.195168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.196236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.196236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.196236] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 907677b7-7720-4fe4-8e60-8c7af60c69da is going to be updated. [ 964.199692] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.199692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.199692] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 964.223390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.224640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.224640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.224640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.224640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.224640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-907677b7-7720-4fe4-8e60-8c7af60c69da" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.292700] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.292901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.292977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.293216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.293327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.293445] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be updated. [ 964.362592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.362746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.362816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.363047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.363228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.380107] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 964.659559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.660594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.660594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.660594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.672852] env[65381]: INFO networking_nsxv3.common.synchronization [req-99e3e4a4-f6df-4f63-b73c-13dbda300da0 req-e8300872-0cd7-43e5-ad4c-94b2a2010f09 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 964.674283] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 964.674283] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.674283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.676755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.677043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.678259] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.678259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.678259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.678259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.678259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.678648] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.694517] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.716319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.716618] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.716749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.716817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.717029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.717119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.717253] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d is going to be updated. [ 964.781733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.781733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.782140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.782140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.782140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.813341] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: IN_PROGRESS for 2s [ 965.138036] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.138036] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.138036] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.138036] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.138036] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.138999] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.139814] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.140219] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.142711] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.142711] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.142711] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.142711] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.142711] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.142711] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.142711] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.142711] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.163121] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.163121] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 965.163121] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.163121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.163121] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-e19ada99-bf72-4eec-a02e-27dc3749ed60 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.163121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.163121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.164682] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.164785] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e19ada99-bf72-4eec-a02e-27dc3749ed60',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.181621] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.198575] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.198818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.198818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.199074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.199183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.199655] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 is going to be created. [ 965.233725] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.233725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.233725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.233725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.234142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.247779] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 in Status: UNINITIALIZED for 2s [ 965.668271] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.668510] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.668510] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.668820] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.668964] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.669130] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port e19ada99-bf72-4eec-a02e-27dc3749ed60 not found, creating... [ 965.669404] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.669567] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.669678] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.669902] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.670049] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.670335] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.670487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.670608] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.670799] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.670927] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.671075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: e19ada99-bf72-4eec-a02e-27dc3749ed60 is going to be created. [ 965.684078] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.694290] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.694290] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.694290] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.694290] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.694676] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.694676] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.186214] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.186616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.186692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.186969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.187085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.187199] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 966.210028] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 966.210028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.210260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.210928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.210928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.210928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.211174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.211237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.211347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.212469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.212469] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.223431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.223609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.223692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.223964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.224146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.243788] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 966.400018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 966.400018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.400018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.400210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.400281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.400403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.400498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.400665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.400747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.400833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.401022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.401115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.401175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.402325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.402325] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.402325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.402325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.402325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.402325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.402325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.402325] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.453371] env[65381]: INFO networking_nsxv3.common.synchronization [req-99e3e4a4-f6df-4f63-b73c-13dbda300da0 req-6978dd54-191e-447a-8409-9940d9d63edf service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 966.453468] env[65381]: INFO networking_nsxv3.common.synchronization [req-99e3e4a4-f6df-4f63-b73c-13dbda300da0 req-6978dd54-191e-447a-8409-9940d9d63edf service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 966.453669] env[65381]: INFO networking_nsxv3.common.synchronization [req-99e3e4a4-f6df-4f63-b73c-13dbda300da0 req-6978dd54-191e-447a-8409-9940d9d63edf service nova] Enqueued Resource ID: e19ada99-bf72-4eec-a02e-27dc3749ed60 with Priority: HIGHEST for action port [ 966.454545] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 966.454545] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 966.454545] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e19ada99-bf72-4eec-a02e-27dc3749ed60 with Priority: HIGHEST for action port [ 966.454813] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.455047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.455110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.455490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.455609] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.456589] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.456698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.456945] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e19ada99-bf72-4eec-a02e-27dc3749ed60 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.457094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.457206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.457412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.458341] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e19ada99-bf72-4eec-a02e-27dc3749ed60',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.718397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.718397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.718397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.718397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.718397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.719438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.720175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.720819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.720819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.723981] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.838833] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb70f39c-753b-4f89-a31c-4120096fef6d in Status: SUCCESS [ 966.839068] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d deletion is rescheduled due to dependency. [ 966.839068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.906226] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0309f4f-d87e-4e36-bcfb-dc749a00a108: rpc.has_security_group_logging(os_id): False [ 966.926338] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.927377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.927566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.928127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.929018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.929018] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.929018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.929018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.929018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.929439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.929757] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.932863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.932863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.932863] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be created. [ 966.961916] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.965085] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e19ada99-bf72-4eec-a02e-27dc3749ed60 with status ACTIVE [ 966.965085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.965085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.965085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.966156] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.966156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.966156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.966156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.966902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.967054] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e19ada99-bf72-4eec-a02e-27dc3749ed60 is going to be updated. [ 967.008191] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.008372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.008372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.008499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.008642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.008827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e19ada99-bf72-4eec-a02e-27dc3749ed60" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.015249] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.015457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.015652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.015836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.016183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.030912] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 967.230025] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 967.246790] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.247070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.247070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.247296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.247400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.249947] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.249947] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.249947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.252658] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.252848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.252848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.253160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.253255] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.253358] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 967.271770] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 in Status: SUCCESS [ 967.271770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.271770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.271770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.272010] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.272107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.272164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.272345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.272409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.272490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.272583] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.344673] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.344869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.344979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.345216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.345367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.489578] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 967.775276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.775457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.775524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.775906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.776121] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.776280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.776343] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.776491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.776596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.776688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.776913] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.776977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.777049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.777179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.777320] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.777413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.777471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.777631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.777686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.777753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.783722] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.255130] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 968.255557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.255628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.255963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.256180] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.256311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.257346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.257346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.257346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.257346] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.287687] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5417c42-09b8-4d6e-a6e5-4941c3e00ca9: rpc.has_security_group_logging(os_id): False [ 968.302111] env[65381]: INFO networking_nsxv3.common.synchronization [req-64664d80-1322-403e-9d18-1020d60274a7 req-4c0afd73-8332-4ac3-924e-e40d6621a1ef tempest-FloatingIPsAssociationTestJSON-1528714218 tempest-FloatingIPsAssociationTestJSON-1528714218-project-member] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 968.302706] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 968.303053] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.303178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.303243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.303461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.304361] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.304686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.304686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.304857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.304957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.305112] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.308555] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.308757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.308757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.309054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.309160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.309436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.309551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.309640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.309801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.309880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.310076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.310170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.310234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.310389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.310441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.310634] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.310728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.310791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.310929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.311368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.311368] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 is going to be created. [ 968.393064] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.393064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.393064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.393064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.393064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.412327] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 in Status: IN_PROGRESS for 2s [ 968.759817] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.809330] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.017039] env[65381]: INFO networking_nsxv3.common.synchronization [req-fd1a5b9f-e2d8-45c0-ba25-22af06eff251 req-95418551-0f6c-44e0-9978-487622ec1f74 tempest-ImagesOneServerNegativeTestJSON-1796536528 tempest-ImagesOneServerNegativeTestJSON-1796536528-project-member] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 969.019302] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGHEST for action security_group_members [ 969.020991] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.020991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.021181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.023091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.023341] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.023996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.023996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.023996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.023996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.023996] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.028541] env[65381]: INFO networking_nsxv3.common.synchronization [req-e0936f7f-1f2b-4497-8ad5-6f94d78994b7 req-d1b8ddd2-d26a-4075-9428-3d68607251af tempest-InstanceActionsNegativeTestJSON-1119724909 tempest-InstanceActionsNegativeTestJSON-1119724909-project-member] Enqueued Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_members [ 969.029207] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b with Priority: HIGHEST for action security_group_members [ 969.029207] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.029415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.029568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.029801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.030697] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.030851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.030936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.031158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.031318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.031501] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.048804] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 969.049067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.049649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.049649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.049649] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.261793] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.311737] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.505511] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 969.505718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.530998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.530998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.530998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.530998] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be updated. [ 969.535367] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.535748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.536134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.536536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.536812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.537194] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.537632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.537993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.538418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.538630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.540021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b is going to be updated. [ 969.553101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.553101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.553101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.553101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.553101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.553485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.553593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.553803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.553928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.554059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.554178] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.567759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.567759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.567759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.568028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.568028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.578167] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.578319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.578391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.578651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.578801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.580472] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: IN_PROGRESS for 2s [ 969.591965] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b in Status: IN_PROGRESS for 2s [ 969.764692] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.764992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.765125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.765380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.765647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.765845] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 969.820528] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.820528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.820528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.820528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.820528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.820815] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be updated. [ 969.853836] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.854520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.854520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.854520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.854520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.870089] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 969.881580] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.881801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.881935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.882254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.882421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.891951] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: IN_PROGRESS for 2s [ 970.060784] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.060989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.061093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.061302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.061563] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.061770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.061770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.061841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.061969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.062046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.062229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.062326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.062388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.062557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.062760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.062874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.062938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.063115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.063190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.063438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.063438] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.427419] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 in Status: SUCCESS [ 970.427730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.567195] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0309f4f-d87e-4e36-bcfb-dc749a00a108: rpc.has_security_group_logging(os_id): False [ 970.587421] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.587573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.587646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.587864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.587968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.588213] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.588314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.588377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.588526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.588602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.588783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.589146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.589146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.589146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.589274] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.589387] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.589445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.590203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.590486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.590615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.590743] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be updated. [ 970.658245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.658440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.658486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.658673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.658822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.670693] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 971.595901] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb in Status: SUCCESS [ 971.596308] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb deletion is rescheduled due to dependency. [ 971.596624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.606691] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b in Status: SUCCESS [ 971.606907] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b deletion is rescheduled due to dependency. [ 971.610092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.862624] env[65381]: INFO networking_nsxv3.common.synchronization [req-df8d07ee-63fd-407d-8ebe-dfcb94260de2 req-29e6c9a7-2384-45ae-894a-4464da8e5768 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_members [ 971.863364] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_members [ 971.863852] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.863978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.864402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.864507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.864703] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.864804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.864870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.865055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.865134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.865262] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.886542] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 971.886795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.887353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.887574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.887775] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.887894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.887958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.888134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.888219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.888306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.889057] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.902427] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 971.902748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.325195] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.325860] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.326088] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.326391] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.326701] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.326875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.326992] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.327253] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.327393] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.327607] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.327723] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.327836] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.327942] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.328066] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.328172] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.328306] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.353425] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.353425] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.353425] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.353425] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.353425] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-b55f10f2-0387-4cdb-970b-7e20d666df0b taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.353690] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.353731] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.354095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.354243] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b55f10f2-0387-4cdb-970b-7e20d666df0b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.369065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.369239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.369674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.369674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.369674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.369934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.370122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.370176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.370371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.370474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.371021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 already deleted. [ 972.371021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.394337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.394337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.394337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.394337] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.394337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.394837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.394837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.394837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.394837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.394837] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.687640] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 972.688053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.857919] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.858100] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.859240] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.860200] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.860386] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.860600] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port b55f10f2-0387-4cdb-970b-7e20d666df0b not found, creating... [ 972.860987] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.861214] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.861365] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.861824] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.862059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.862451] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.862631] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.862749] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.863157] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.866681] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.866681] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: b55f10f2-0387-4cdb-970b-7e20d666df0b is going to be created. [ 972.895394] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.895574] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.898408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.898408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.898408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.898408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.900504] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f08ea40-f56b-4bd5-a0f9-e991cad65528: rpc.has_security_group_logging(os_id): False [ 972.925375] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.925713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.925808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.926119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.927408] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.927408] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.927408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.928079] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.928079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.928079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.928360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.928360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.928475] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 973.071488] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.071747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.071829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.072036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.072321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.090798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 973.173601] env[65381]: INFO networking_nsxv3.common.synchronization [req-0b5a82fe-4191-4c04-8723-b9f5353e9132 req-319f7b3c-2679-4f69-bc3b-449a404fb751 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 973.174224] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 973.174546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.174691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.174799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.175215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.175318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.175474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.175550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.175748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.175870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.176015] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.656657] env[65381]: INFO networking_nsxv3.common.synchronization [req-df8d07ee-63fd-407d-8ebe-dfcb94260de2 req-534c929c-00ec-4c92-9804-a7bb50618913 service nova] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_rules [ 973.657365] env[65381]: INFO networking_nsxv3.common.synchronization [req-df8d07ee-63fd-407d-8ebe-dfcb94260de2 req-534c929c-00ec-4c92-9804-a7bb50618913 service nova] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_members [ 973.657365] env[65381]: INFO networking_nsxv3.common.synchronization [req-df8d07ee-63fd-407d-8ebe-dfcb94260de2 req-534c929c-00ec-4c92-9804-a7bb50618913 service nova] Enqueued Resource ID: b55f10f2-0387-4cdb-970b-7e20d666df0b with Priority: HIGHEST for action port [ 973.657519] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_rules [ 973.657714] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_members [ 973.657828] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55f10f2-0387-4cdb-970b-7e20d666df0b with Priority: HIGHEST for action port [ 973.658179] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.658294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.658361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.661128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.661128] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.662968] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.663378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.663378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.663378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.663550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.663626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.663690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.663842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.663927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.664061] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.665885] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b55f10f2-0387-4cdb-970b-7e20d666df0b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.665885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.665885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.665885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.665885] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b55f10f2-0387-4cdb-970b-7e20d666df0b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.678493] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.167077] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.167429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.167472] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.169754] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b55f10f2-0387-4cdb-970b-7e20d666df0b with status ACTIVE [ 974.169980] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.170121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.170184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.170404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.170486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.170676] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.171052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.171052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.171052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.171052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.171230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.171342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.171423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.172188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.172343] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.172454] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b55f10f2-0387-4cdb-970b-7e20d666df0b is going to be updated. [ 974.182088] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.200934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.201169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.201324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.201848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.201848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.202056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b55f10f2-0387-4cdb-970b-7e20d666df0b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.456496] env[65381]: INFO networking_nsxv3.common.synchronization [req-ca955ec1-d7cc-44f6-ad6b-4f7af9a21eee req-2535f7c7-2b5e-43c3-96c7-b33d1004bb8c tempest-ServerRescueTestJSON-1175753319 tempest-ServerRescueTestJSON-1175753319-project-member] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 974.458462] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 974.459101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.459362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.459494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.460150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.460150] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.460330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.460746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.460746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.460746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.460894] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.670611] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.684449] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.684719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.684719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.685904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.685904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.685904] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 974.728080] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.728251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.728290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.728512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.728656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.745567] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 974.850431] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.850665] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.850837] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.851491] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.851491] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.851699] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.851823] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.852067] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.852149] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.852324] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.852444] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.852533] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.852650] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.852760] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.852874] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.853018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.877402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.877652] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.877747] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.877939] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.878311] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-ecd95515-8887-48ef-80e0-a77e5e9c0878 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.878636] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.878636] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.878958] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.879122] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecd95515-8887-48ef-80e0-a77e5e9c0878',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.964254] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.965087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.965087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.965087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.965087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.965418] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.965418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.965418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.965606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.965606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.965606] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d already deleted. [ 974.965707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.109106] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 975.109260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.173448] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.173984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.173984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.173984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.174154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.174355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 is going to be created. [ 975.205036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.205036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.205036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.205036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.205036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.229191] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: UNINITIALIZED for 2s [ 975.382000] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.382261] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.382427] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.382686] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.383357] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.383357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port ecd95515-8887-48ef-80e0-a77e5e9c0878 not found, creating... [ 975.383357] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.383530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.383583] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.383926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.384070] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.384508] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.384741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.386050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.386050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.386508] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.386508] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: ecd95515-8887-48ef-80e0-a77e5e9c0878 is going to be created. [ 975.410990] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.411493] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.412554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.412554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.412554] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.412934] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.203931] env[65381]: INFO networking_nsxv3.common.synchronization [req-ca955ec1-d7cc-44f6-ad6b-4f7af9a21eee req-1350164a-99fe-4e01-a89e-ea63f7e53ad7 service nova] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_rules [ 976.204386] env[65381]: INFO networking_nsxv3.common.synchronization [req-ca955ec1-d7cc-44f6-ad6b-4f7af9a21eee req-1350164a-99fe-4e01-a89e-ea63f7e53ad7 service nova] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 976.204386] env[65381]: INFO networking_nsxv3.common.synchronization [req-ca955ec1-d7cc-44f6-ad6b-4f7af9a21eee req-1350164a-99fe-4e01-a89e-ea63f7e53ad7 service nova] Enqueued Resource ID: ecd95515-8887-48ef-80e0-a77e5e9c0878 with Priority: HIGHEST for action port [ 976.205332] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_rules [ 976.205496] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 976.205589] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd95515-8887-48ef-80e0-a77e5e9c0878 with Priority: HIGHEST for action port [ 976.205960] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.206209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.206209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.206572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.206684] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.207934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.208114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.208195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.208439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.208653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.208789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.208876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.209308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.209308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.209308] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.210563] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecd95515-8887-48ef-80e0-a77e5e9c0878 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.210695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.210790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.210991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.211104] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecd95515-8887-48ef-80e0-a77e5e9c0878',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.714433] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.716042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.716042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.716042] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecd95515-8887-48ef-80e0-a77e5e9c0878 with status ACTIVE [ 976.716311] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.716446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.716522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.716841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.717012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.717325] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.717533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.717705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.717982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.718157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.718472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.720768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.720768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.720768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.720768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.720768] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecd95515-8887-48ef-80e0-a77e5e9c0878 is going to be updated. [ 976.747280] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.747421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.747505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.748573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.748573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.748573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecd95515-8887-48ef-80e0-a77e5e9c0878" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.758991] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 976.759682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.061034] env[65381]: INFO networking_nsxv3.common.synchronization [req-dca194d3-6965-4f85-920c-9bb2689f2b4c req-2257dd4e-bc00-42a4-99df-6b0b606ca612 tempest-AttachInterfacesV270Test-640228452 tempest-AttachInterfacesV270Test-640228452-project-member] Enqueued Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_members [ 977.062041] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_members [ 977.062041] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.062223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.062347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.062730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.063067] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.063285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.063430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.063749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.063922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.064117] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.221528] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.243217] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: SUCCESS [ 977.243217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.243217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.243217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.243217] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.243217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.243217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.243478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.243478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.243478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.245389] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.421532] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.421677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-752" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.421796] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-752" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.422154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-752" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.422405] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.422557] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.422677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.422891] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.423233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.423477] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.423588] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.423818] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.424048] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.424183] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.424297] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.425043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.444762] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.444960] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.445110] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.445285] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-752" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.445594] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.445768] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.446120] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.446449] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.446586] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c4d27bf-dc20-4174-baac-46f5f8c5dc12',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.566541] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.566706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.566781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.567058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.567126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.567299] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.567399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.567462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.567615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.567689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.567777] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23475551-8968-4429-bd3c-c9fca786a07e already deleted. [ 977.567858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.726996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.726996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.726996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.726996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.726996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.726996] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be created. [ 977.747412] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.786433] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.786979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.788281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.788281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.788281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.819399] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: UNINITIALIZED for 2s [ 977.949905] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.950212] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.950348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.950648] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.950801] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.952183] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 6c4d27bf-dc20-4174-baac-46f5f8c5dc12 not found, creating... [ 977.952620] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.953310] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.953549] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.953933] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.954328] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.954786] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.955196] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.955359] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.955622] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.955773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.955919] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 6c4d27bf-dc20-4174-baac-46f5f8c5dc12 is going to be created. [ 977.978737] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.979037] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.979196] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.979512] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.979782] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.980081] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.248543] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784f4514-1cec-43fd-97c8-9a7ad1576b94: rpc.has_security_group_logging(os_id): False [ 978.270882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.271075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.271126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.271336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.271424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.271688] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.271784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.271839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.272011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.272276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.272276] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 is going to be created. [ 978.357284] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.357475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.357475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.357778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.357980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.375449] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: IN_PROGRESS for 2s [ 978.788027] env[65381]: INFO networking_nsxv3.common.synchronization [req-dca194d3-6965-4f85-920c-9bb2689f2b4c req-1604164c-e2fa-4876-ae38-774c77423cc5 service nova] Enqueued Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_rules [ 978.788027] env[65381]: INFO networking_nsxv3.common.synchronization [req-dca194d3-6965-4f85-920c-9bb2689f2b4c req-1604164c-e2fa-4876-ae38-774c77423cc5 service nova] Enqueued Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_members [ 978.788027] env[65381]: INFO networking_nsxv3.common.synchronization [req-dca194d3-6965-4f85-920c-9bb2689f2b4c req-1604164c-e2fa-4876-ae38-774c77423cc5 service nova] Enqueued Resource ID: 6c4d27bf-dc20-4174-baac-46f5f8c5dc12 with Priority: HIGHEST for action port [ 978.788027] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_rules [ 978.788027] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_members [ 978.788027] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c4d27bf-dc20-4174-baac-46f5f8c5dc12 with Priority: HIGHEST for action port [ 978.789514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.792029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.792029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.792029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.792029] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.792029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.792029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.792029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.797026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.797026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.797026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.797026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.797026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c4d27bf-dc20-4174-baac-46f5f8c5dc12',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.298069] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.299317] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.299525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.299946] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c4d27bf-dc20-4174-baac-46f5f8c5dc12 with status ACTIVE [ 979.300056] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.300215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.300304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.300531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.300620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.300887] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.301026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.303432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.303671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.303834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.304096] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.304213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.304322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.304441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.304524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.304625] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c4d27bf-dc20-4174-baac-46f5f8c5dc12 is going to be updated. [ 979.333305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.333479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.333560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.333753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.333903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.334088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c4d27bf-dc20-4174-baac-46f5f8c5dc12" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.801480] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.832244] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 979.832494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.832726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.833090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.833328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.833452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.833627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.833847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.834573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.834573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.834573] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.305632] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.306065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.306065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.306182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.306182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.306302] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23475551-8968-4429-bd3c-c9fca786a07e is going to be created. [ 980.336682] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.337337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.337337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.337337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.337557] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.337689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.337742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.337936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.338045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.338142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.338519] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.338519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.338519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.338701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.338737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.338870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.338870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.338995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.339503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.339600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.339693] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.341869] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.342050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.342095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.342295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.342462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.358139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23475551-8968-4429-bd3c-c9fca786a07e in Status: UNINITIALIZED for 2s [ 980.390040] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: SUCCESS [ 980.390297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.493161] env[65381]: INFO networking_nsxv3.common.synchronization [None req-0934cb98-ddeb-4b4e-95dc-fd57092a940e tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: 33a23502-7968-4dfa-bbe5-d1da970e3c50 with Priority: HIGHEST for action security_group_rules [ 980.493161] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a23502-7968-4dfa-bbe5-d1da970e3c50 with Priority: HIGHEST for action security_group_rules [ 980.494820] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33a23502-7968-4dfa-bbe5-d1da970e3c50 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.495197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.495414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.496118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.496299] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33a23502-7968-4dfa-bbe5-d1da970e3c50',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.594948] env[65381]: INFO networking_nsxv3.common.synchronization [None req-7c54d519-3d15-4c34-af54-6052919ff9b8 tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: 33a23502-7968-4dfa-bbe5-d1da970e3c50 with Priority: HIGHEST for action security_group_rules [ 980.596217] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a23502-7968-4dfa-bbe5-d1da970e3c50 with Priority: HIGHEST for action security_group_rules [ 980.596513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33a23502-7968-4dfa-bbe5-d1da970e3c50 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.596513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.844912] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e39161d0-dcb4-484d-ae0c-3dc95815f63d: rpc.has_security_group_logging(os_id): False [ 980.866952] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.867138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.867216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.867444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.867542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.867837] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.867942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.867942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.868493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.868493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.868493] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.868493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.868712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.868712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.868816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.868895] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.870498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.870498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.870998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.870998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.870998] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be created. [ 980.981542] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.983546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.983546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.983546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.983546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.001469] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: IN_PROGRESS for 2s [ 981.028836] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.028836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.028836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.029085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.029085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.029152] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33a23502-7968-4dfa-bbe5-d1da970e3c50 already deleted. [ 981.029199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.029661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.029661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.029661] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33a23502-7968-4dfa-bbe5-d1da970e3c50',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.551903] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.552259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.552259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.552489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.552636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.552742] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33a23502-7968-4dfa-bbe5-d1da970e3c50 already deleted. [ 981.552850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33a23502-7968-4dfa-bbe5-d1da970e3c50" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.371940] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23475551-8968-4429-bd3c-c9fca786a07e in Status: SUCCESS [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.371940] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.371940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.371940] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.875848] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.876382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.876382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.878129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.878129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.878129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.878129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.878129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.878129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.878129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.878129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.879331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.879331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.879331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.879331] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.879331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.879791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.879870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.879984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.880894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.880894] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.017221] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 983.017514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.383364] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23475551-8968-4429-bd3c-c9fca786a07e: rpc.has_security_group_logging(os_id): False [ 983.405396] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.405585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.405662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.405827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.405917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.406206] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.406312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.406364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.406514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.406589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.406761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.406853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.406913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.407119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.407162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.407304] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.407393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.407451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.408116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.408116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.408116] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23475551-8968-4429-bd3c-c9fca786a07e is going to be created. [ 983.502157] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.502157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.502157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.502157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.502157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.551836] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23475551-8968-4429-bd3c-c9fca786a07e in Status: IN_PROGRESS for 2s [ 983.774889] env[65381]: INFO networking_nsxv3.common.synchronization [req-05933561-8598-4b9b-a9f8-af3880f7633d req-b9bb9f38-70dc-410a-beed-8813e0dbd7d6 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 983.775889] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 983.776443] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.776612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.776692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.776930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.777221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.777338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.777379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.777575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.777711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.777783] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.284015] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.284015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.284015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.284015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.284015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.284015] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.284667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.284667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.284667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.284667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.284667] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 984.316508] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.316692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.316692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.316916] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.317077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.329089] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 984.365376] env[65381]: INFO networking_nsxv3.common.synchronization [req-4b82a2a9-10f3-4616-ac69-caa6e61935bf req-c1f6797b-deb9-4c59-a45d-3290654b8054 tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 984.366157] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 984.366708] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.367879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.368365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.368484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.368758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.368989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.370073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.370073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.370073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.370073] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.874328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.874637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.874637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.875166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.875166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.875166] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.875429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.875429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.875429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.876820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.876820] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 984.913949] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.913949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.913949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.915087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.915087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.935349] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 984.993579] env[65381]: INFO networking_nsxv3.common.synchronization [req-19e9e353-d349-4d01-9e35-00fe02ea43f4 req-9eca74bd-b81a-4d79-a675-9f97cb2ba518 tempest-FloatingIPsAssociationNegativeTestJSON-797311109 tempest-FloatingIPsAssociationNegativeTestJSON-797311109-project-member] Enqueued Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_members [ 984.994199] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGHEST for action security_group_members [ 984.994527] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.994654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.994756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.995073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.995159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.995284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.995353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.996126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.996126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.996126] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.498589] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.498913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.498913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.499159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.499538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.500497] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.500497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.500497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.500689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.501902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.501902] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 is going to be updated. [ 985.534445] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.534617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.534654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.534919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.535134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.546566] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 in Status: IN_PROGRESS for 2s [ 985.567492] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23475551-8968-4429-bd3c-c9fca786a07e in Status: SUCCESS [ 985.567764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.343153] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 986.343376] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 986.343517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.948697] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 986.948697] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 986.948697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.299419] env[65381]: INFO networking_nsxv3.common.synchronization [req-b73f330e-b84f-4e8a-959d-40b206ba1c88 req-52ff7af0-9d28-417e-a6b6-dda37e61a451 tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_members [ 987.300388] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGHEST for action security_group_members [ 987.300513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.300611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.300674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.300847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.300994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.301121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.301184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.301337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.301417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.301511] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.557928] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 in Status: SUCCESS [ 987.558066] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 deletion is rescheduled due to dependency. [ 987.560140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.805908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.805908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.805908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.805908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.812923] env[65381]: INFO networking_nsxv3.common.synchronization [req-5f31d8b1-8afd-4495-a64a-1251eb1115dd req-85850f19-ec95-4842-9e5c-deeb1d57b3b3 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 987.813564] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 987.813908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.815155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.817169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.817169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.817290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.817373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.817436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.817591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.817676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.817779] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.829723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.829723] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.829723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.829723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.829723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.829723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.829723] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 is going to be updated. [ 987.865848] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.865848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.866132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.866210] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.866357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.878841] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 in Status: IN_PROGRESS for 2s [ 988.321593] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.824521] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.328254] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.328589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.328589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.328659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.328702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.328805] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 989.361042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.361249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.361322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.361529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.361677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.372032] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 989.890179] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 in Status: SUCCESS [ 989.890352] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 deletion is rescheduled due to dependency. [ 989.890446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.056401] env[65381]: INFO networking_nsxv3.common.synchronization [req-8554cfa7-ee08-49f1-baa0-87e8accbc6c6 req-d4144326-c9d0-460b-8cbd-70bd89ae2583 tempest-FloatingIPsAssociationTestJSON-1528714218 tempest-FloatingIPsAssociationTestJSON-1528714218-project-member] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 991.057979] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGHEST for action security_group_members [ 991.058346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.058478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.058547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.058754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.058921] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.059040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.059106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.059253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.059337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.059431] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.386381] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 991.386934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.565021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.565021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.565021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.565291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.567760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.567760] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.567760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.567760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.567760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.567760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.567760] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be updated. [ 991.599029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.599029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.599029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.599029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.599029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.612837] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: IN_PROGRESS for 2s [ 993.626833] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 in Status: SUCCESS [ 993.627776] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 deletion is rescheduled due to dependency. [ 993.627776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.814548] env[65381]: INFO networking_nsxv3.common.synchronization [req-8d46cc93-42c4-41e5-acb0-9686e5020251 req-9edba4c3-a978-4788-9581-4b96eec1324f tempest-AttachInterfacesV270Test-640228452 tempest-AttachInterfacesV270Test-640228452-project-member] Enqueued Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_members [ 994.815654] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGHEST for action security_group_members [ 994.815862] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.815920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.815968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.816352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.816532] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.816645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.816711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.816970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.817108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.817366] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.320374] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.320573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.320672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.320880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.320997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.321242] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.321370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.321433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.321816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.321816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.321990] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23475551-8968-4429-bd3c-c9fca786a07e is going to be updated. [ 995.352082] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.352284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.352374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.352665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.352863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.363297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23475551-8968-4429-bd3c-c9fca786a07e in Status: IN_PROGRESS for 2s [ 995.708391] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5a08c133-8a15-46e0-9457-61f3445f7e16 tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_rules [ 995.709323] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_rules [ 995.709323] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.709480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.709480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.709775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.710087] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.808850] env[65381]: INFO networking_nsxv3.common.synchronization [None req-bd50e7fc-ff65-47eb-9354-f83f2cdf577f tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_rules [ 995.809476] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_rules [ 995.809894] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.810012] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.235867] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.235867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.236310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.236527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.236626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.236733] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 already deleted. [ 996.236905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.237088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.237331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.237966] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.758169] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.758408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.758510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.758761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.758970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.758970] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 already deleted. [ 996.759071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.379015] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23475551-8968-4429-bd3c-c9fca786a07e in Status: SUCCESS [ 997.379340] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23475551-8968-4429-bd3c-c9fca786a07e deletion is rescheduled due to dependency. [ 997.379450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.029030] env[65381]: INFO networking_nsxv3.common.synchronization [req-41043fa4-cb55-4c07-a1e8-eb1f71ff2ef1 req-41a8dffe-c767-47e5-be9c-f1fb56c5517f tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1000.029030] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1000.029438] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.029438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.029539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.029707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.029860] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.030091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.030091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.030262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.030320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.030697] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.368655] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.368846] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.368911] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.369218] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.369482] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.369663] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.369787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.370016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.370215] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.370429] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.370644] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.370764] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.370872] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.370984] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.371103] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.371263] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.395308] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.395308] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.395308] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.395308] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.395308] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.395536] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.395536] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.395822] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.395963] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54465b4e-f5b6-46c3-bb4c-9ea3489db6e5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.533761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.534016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.534119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.534374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.534466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.534663] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.534762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.534872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.534981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.535073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.535161] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 1000.567112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.567291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.567377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.567629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.567805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.577366] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 1000.898661] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.898904] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.899041] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.899418] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.899561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.899638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 not found, creating... [ 1000.900508] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.900508] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.900508] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.900508] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.900784] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.902087] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.902087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.902087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.902087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.902087] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.902087] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 is going to be created. [ 1000.924130] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.924367] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.924493] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.924764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.925040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.925281] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.642198] env[65381]: INFO networking_nsxv3.common.synchronization [req-41043fa4-cb55-4c07-a1e8-eb1f71ff2ef1 req-6811c59a-ca04-40ed-94a3-4541f04ea169 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 1001.642415] env[65381]: INFO networking_nsxv3.common.synchronization [req-41043fa4-cb55-4c07-a1e8-eb1f71ff2ef1 req-6811c59a-ca04-40ed-94a3-4541f04ea169 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1001.642574] env[65381]: INFO networking_nsxv3.common.synchronization [req-41043fa4-cb55-4c07-a1e8-eb1f71ff2ef1 req-6811c59a-ca04-40ed-94a3-4541f04ea169 service nova] Enqueued Resource ID: 54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 with Priority: HIGHEST for action port [ 1001.643140] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 1001.643285] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1001.643405] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 with Priority: HIGHEST for action port [ 1001.646729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.646729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.646729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.646729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.646729] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.646729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.646729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.647361] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.647361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.647361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.647361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.647361] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54465b4e-f5b6-46c3-bb4c-9ea3489db6e5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.149422] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.149522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.149902] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 with status ACTIVE [ 1002.150178] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.150288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.150288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.150810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.150810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.150810] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.151050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.151101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.151313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.151423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.151623] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.151817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.151817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.152149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.152149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.152149] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54465b4e-f5b6-46c3-bb4c-9ea3489db6e5 is going to be updated. [ 1002.175112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.175112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.175112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.175112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.175112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.175374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54465b4e-f5b6-46c3-bb4c-9ea3489db6e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.477402] env[65381]: INFO networking_nsxv3.common.synchronization [req-2f2e25e6-4d1a-44d1-9597-04e02fe402d3 req-8cfc0a44-1ba6-4eff-b1b7-1314c464db9f tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1002.477890] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1002.478421] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.478546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.478615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.478817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.478967] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.479080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.479144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.479299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.479384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.479487] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.588406] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1002.588406] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 1002.588406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.588645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.588955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.589274] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.589405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.589474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.589657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.589772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.589840] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.989114] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.989114] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.989114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.989114] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1003.021430] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.021430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.021430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.021430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.021430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.032544] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1003.092688] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.276450] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.276450] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.276725] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.276909] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.278251] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.278251] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.278251] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.278634] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.279148] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.279148] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.279231] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.279662] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.279662] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.279662] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.279831] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.280285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.300154] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.300154] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.300154] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.300154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.300154] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.300154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.300154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.300670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.300670] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.595811] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.802439] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.802673] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.803363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.803363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.803743] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.803743] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 not found, creating... [ 1003.803917] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.804112] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.804308] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.804899] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.804899] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.805220] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.805431] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.805576] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.805819] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.806093] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.806158] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 is going to be created. [ 1003.839830] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.840081] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.840223] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.840504] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.840733] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.840958] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.099843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.099843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.099843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.099843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.099843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.099843] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 1004.133245] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.133382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.133431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.133651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.133815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.144818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 1004.510054] env[65381]: INFO networking_nsxv3.common.synchronization [req-2f2e25e6-4d1a-44d1-9597-04e02fe402d3 req-b6670164-3791-440a-9a87-dad83c4c0b6e service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 1004.510178] env[65381]: INFO networking_nsxv3.common.synchronization [req-2f2e25e6-4d1a-44d1-9597-04e02fe402d3 req-b6670164-3791-440a-9a87-dad83c4c0b6e service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1004.510359] env[65381]: INFO networking_nsxv3.common.synchronization [req-2f2e25e6-4d1a-44d1-9597-04e02fe402d3 req-b6670164-3791-440a-9a87-dad83c4c0b6e service nova] Enqueued Resource ID: 08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 with Priority: HIGHEST for action port [ 1004.510874] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 1004.511026] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1004.511562] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 with Priority: HIGHEST for action port [ 1004.511655] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.511792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.511885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.514328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.514328] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.514328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.514328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.514328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.514328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.514328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.514328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.514328] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.016336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.016532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.016821] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 with status ACTIVE [ 1005.017090] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.017258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.017362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.017666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.017799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.018064] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.018219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.018305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.018492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.018622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.018770] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.018870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.018944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.021806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.021806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.021806] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41 is going to be updated. [ 1005.045184] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1005.045379] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 1005.045496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.045672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.045894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.046100] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.046229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.046336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.046797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.046797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.046797] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.049321] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.049442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.049580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.049700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.049840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.049991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08bd3d9e-141c-4bf6-9dc4-02d2b04b6a41" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.321506] env[65381]: INFO networking_nsxv3.common.synchronization [req-14438743-e9c7-4919-9356-b26069ecfdfb req-ccba3ae9-df8b-42de-ba3a-c1dd94d46c73 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1005.322070] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1005.322387] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.322514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.322582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.322805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.322928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.323065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.323104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.323314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.324215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.324215] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.398055] env[65381]: INFO networking_nsxv3.common.synchronization [req-e2b5999a-875d-496c-a1f0-a834dccd8462 req-deb30243-bb8a-41dd-8126-a53fe2572aca tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1005.398704] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1005.399036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.399181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.399242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.399426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.399584] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.399682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.399745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.399897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.399984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.400093] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.548708] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.659218] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1005.659218] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1005.826214] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.902531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.902531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.902531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.902777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.902777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.902847] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.902937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.903095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.903150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.903398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.903398] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 1005.932177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.932326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.932396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.932607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.932746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.936777] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.936966] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.937107] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.937363] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.937615] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.937770] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.937908] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.938245] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.938433] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.938684] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.938840] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.938968] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.939123] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.939261] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.939382] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.939545] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.943179] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 1005.959135] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.959388] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.959551] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.959780] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.960191] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-c85769cb-d386-4b73-8abc-6a0787730537 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.960408] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.960577] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.960988] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.961216] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c85769cb-d386-4b73-8abc-6a0787730537',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.045449] env[65381]: INFO networking_nsxv3.common.synchronization [None req-85556688-cba1-40d2-83ec-49f0175703dd None None] Enqueued Resource ID: bb822da5-791f-4857-be1a-79d445af3989 with Priority: HIGHEST for action port [ 1006.045449] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb822da5-791f-4857-be1a-79d445af3989 with Priority: HIGHEST for action port [ 1006.045449] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb822da5-791f-4857-be1a-79d445af3989 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.045449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb822da5-791f-4857-be1a-79d445af3989" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.045449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb822da5-791f-4857-be1a-79d445af3989" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.046110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb822da5-791f-4857-be1a-79d445af3989" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.046323] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb822da5-791f-4857-be1a-79d445af3989',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.052033] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.157209] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1006.157428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.157618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.157837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.158040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.158167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.158233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.158391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.158473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.158559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.158650] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.329184] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.463605] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.464041] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.464205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.464492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.464630] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.464786] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port c85769cb-d386-4b73-8abc-6a0787730537 not found, creating... [ 1006.465187] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.465351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.465462] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.465687] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.465816] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.466111] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.466279] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.466395] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.466638] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.466793] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.466947] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: c85769cb-d386-4b73-8abc-6a0787730537 is going to be created. [ 1006.498446] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.498638] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.498812] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.499071] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.499389] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.499538] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.549285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb822da5-791f-4857-be1a-79d445af3989 [ 1006.549525] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.549661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.549730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.549950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.550054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.550155] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb822da5-791f-4857-be1a-79d445af3989 already deleted. [ 1006.550239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb822da5-791f-4857-be1a-79d445af3989" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.554793] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.554952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.555042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.555246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.555333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.555428] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1006.639384] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.639591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.639671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.639935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.640106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.663186] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.663186] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.663186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.664198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.664198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.664198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.664198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.664198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.664198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.664198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.664518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.664518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.664518] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.664613] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.666845] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1006.831026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.831202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.831283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.831600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.831694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.831801] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1006.870213] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.871054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.871054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.871054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.871054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.883227] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1007.167981] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9c03ef0-b5e2-4757-9488-6558cc6e9841: rpc.has_security_group_logging(os_id): False [ 1007.189454] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.189454] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.189454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.189898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.189898] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.189898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.189898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.190103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.190144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.190323] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.190421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.190475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.191226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.191310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.191405] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 1007.262394] env[65381]: INFO networking_nsxv3.common.synchronization [req-14438743-e9c7-4919-9356-b26069ecfdfb req-69759d1a-42e9-4bfa-a336-e713b4810102 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1007.262576] env[65381]: INFO networking_nsxv3.common.synchronization [req-14438743-e9c7-4919-9356-b26069ecfdfb req-69759d1a-42e9-4bfa-a336-e713b4810102 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1007.262714] env[65381]: INFO networking_nsxv3.common.synchronization [req-14438743-e9c7-4919-9356-b26069ecfdfb req-69759d1a-42e9-4bfa-a336-e713b4810102 service nova] Enqueued Resource ID: c85769cb-d386-4b73-8abc-6a0787730537 with Priority: HIGHEST for action port [ 1007.264041] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1007.264247] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1007.264378] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c85769cb-d386-4b73-8abc-6a0787730537 with Priority: HIGHEST for action port [ 1007.268380] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.268484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.268820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.268820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.268820] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.269764] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.270059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.270122] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c85769cb-d386-4b73-8abc-6a0787730537 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.270187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.270236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.270919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.271106] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c85769cb-d386-4b73-8abc-6a0787730537',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.276775] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.276775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.280026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.280026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.280026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.291656] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 1007.689314] env[65381]: INFO networking_nsxv3.common.synchronization [None req-733713fa-0513-4fa9-aa7b-ff8fb7552c05 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1007.689314] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1007.689698] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.689698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.689785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.689988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.690091] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.773597] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.774081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.774522] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c85769cb-d386-4b73-8abc-6a0787730537 with status ACTIVE [ 1007.774650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.774776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.775396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.775714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.775841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.776281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.776281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.776281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.776665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.776777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.777043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.777203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.777291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.777471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.777574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.777684] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c85769cb-d386-4b73-8abc-6a0787730537 is going to be updated. [ 1007.806850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.807315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.807574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.807691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.807835] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.808128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c85769cb-d386-4b73-8abc-6a0787730537" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.824790] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a93359a9-83dd-475d-b2a8-7e10414d1548 tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_rules [ 1007.824970] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_rules [ 1007.826062] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.826351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.826454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.826767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.826971] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.936033] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5b1b8c10-8c8c-4618-9849-5e3ee9201f52 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1007.936463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1007.937088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.937248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.956160] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 1007.956415] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 1007.956566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.088957] env[65381]: INFO networking_nsxv3.common.synchronization [None req-35fad506-f8f4-49c2-94f4-d63afa2b8954 tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_rules [ 1008.089651] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_rules [ 1008.093051] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.093237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.233780] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.234058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.234157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.234427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.234600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.234940] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 already deleted. [ 1008.235096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.235321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.235573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.235688] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.353952] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.353952] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d already deleted. [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.353952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.353952] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.688638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1008.689172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.689357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.689586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.689787] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.689901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.689984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.690139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.690224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.690319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.690403] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.762362] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.762506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.762571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.762779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.762863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.762970] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 already deleted. [ 1008.763071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.820471] env[65381]: INFO networking_nsxv3.common.synchronization [None req-0a64cb93-3828-4df3-96f7-0186d175c56c None None] Enqueued Resource ID: 23153577-9214-41a5-9bfd-65b5cd17803a with Priority: HIGHEST for action port [ 1008.821619] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23153577-9214-41a5-9bfd-65b5cd17803a with Priority: HIGHEST for action port [ 1008.821619] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-23153577-9214-41a5-9bfd-65b5cd17803a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.821619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23153577-9214-41a5-9bfd-65b5cd17803a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.821619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23153577-9214-41a5-9bfd-65b5cd17803a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.821902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23153577-9214-41a5-9bfd-65b5cd17803a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.821902] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23153577-9214-41a5-9bfd-65b5cd17803a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.878301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.878301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.878301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.878301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.878301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.878301] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d already deleted. [ 1008.878301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.895034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1008.895495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.895632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.895937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.896647] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.896647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.896647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.896647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.896647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.896647] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.192713] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.192713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.192713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.192713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.192955] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.192955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.192955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.193077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.193576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.193576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.193576] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.193576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.193576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.193837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.195123] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.195123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.195267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.195327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.195414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.195505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.195598] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.307314] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1009.307314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.325701] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23153577-9214-41a5-9bfd-65b5cd17803a [ 1009.326318] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.326540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.326624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.326866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.326978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.327120] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23153577-9214-41a5-9bfd-65b5cd17803a already deleted. [ 1009.327282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23153577-9214-41a5-9bfd-65b5cd17803a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.401052] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.687780] env[65381]: INFO networking_nsxv3.common.synchronization [req-85f507be-35e3-4bef-b0c9-1002032ebc24 req-ab861ae5-e1c0-4250-8937-9b74e69af837 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_members [ 1009.689603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGHEST for action security_group_members [ 1009.689603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.689603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.689603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.689603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.689603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.690219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.690219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.690219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.690219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.690219] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.698447] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a23f96-505a-4b63-87f3-5175bacc51ab: rpc.has_security_group_logging(os_id): False [ 1009.761630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.761630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.761630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.761630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.761871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.762328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.763471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.763471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.763471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.763471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.763471] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.763471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.763471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.763816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.764466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.764737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.764906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.765165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.765165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.765263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.765354] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1009.890689] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.890689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.890689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.890689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.890689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.905289] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.909099] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1010.193935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.194204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.194288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.194520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.194613] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.194817] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.194953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.195040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.195195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.195298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.195420] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c is going to be updated. [ 1010.225977] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.226222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.226298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.226584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.226793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.239586] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495a081-8211-4db6-af3d-10fc0b2f521c in Status: IN_PROGRESS for 2s [ 1010.408360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.408450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.408532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.410211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.410211] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.410211] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1010.454031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.454031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.454031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.454031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.454031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.464523] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1011.741171] env[65381]: INFO networking_nsxv3.common.synchronization [req-98f11543-4c0a-4ef5-989b-06825fff8b3a req-7ef3b2b4-eb26-4fa5-aded-b92887ad57b4 tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_members [ 1011.742484] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_members [ 1011.743251] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.744174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.744174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.744174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.744527] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.744668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.744773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.745008] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.745153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.745313] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.927934] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1011.927934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.130563] env[65381]: INFO networking_nsxv3.common.synchronization [None req-dc286681-5600-4aee-9b96-595bcaeead6f None None] Enqueued Resource ID: a29337a7-aa3c-4eed-84bd-5806ec31f5e9 with Priority: HIGHEST for action port [ 1012.131164] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29337a7-aa3c-4eed-84bd-5806ec31f5e9 with Priority: HIGHEST for action port [ 1012.131504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a29337a7-aa3c-4eed-84bd-5806ec31f5e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.131634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a29337a7-aa3c-4eed-84bd-5806ec31f5e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.131700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a29337a7-aa3c-4eed-84bd-5806ec31f5e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.131982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a29337a7-aa3c-4eed-84bd-5806ec31f5e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.133941] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a29337a7-aa3c-4eed-84bd-5806ec31f5e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.164188] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-649 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.165840] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.165840] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.165840] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.165840] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.165840] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.166741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.169964] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.169964] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.169964] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.169964] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.169964] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.169964] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.169964] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.169964] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.169964] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.190792] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.190792] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.191112] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.191112] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-649" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.191398] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-62625c96-6723-456b-bf3c-83161568d0ed taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.191603] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.191719] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.192209] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.192428] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62625c96-6723-456b-bf3c-83161568d0ed',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.248790] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.248961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.249066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.249346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.249448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.249655] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.249757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.249825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.249981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.250075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.250164] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 already deleted. [ 1012.250248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.251139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b495a081-8211-4db6-af3d-10fc0b2f521c in Status: SUCCESS [ 1012.251306] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c deletion is rescheduled due to dependency. [ 1012.251400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.474224] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1012.474394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.475089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.475089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.475089] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.475089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.475436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.475436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.475436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.475628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.475628] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.637238] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a29337a7-aa3c-4eed-84bd-5806ec31f5e9 [ 1012.637801] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.638044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.638182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.638517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.638671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.638830] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a29337a7-aa3c-4eed-84bd-5806ec31f5e9 already deleted. [ 1012.638965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a29337a7-aa3c-4eed-84bd-5806ec31f5e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.694608] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.695546] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.695546] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.695546] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.695546] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.695781] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 62625c96-6723-456b-bf3c-83161568d0ed not found, creating... [ 1012.695828] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.695989] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.696118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.696359] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.696513] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.696916] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.697188] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.697339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.697563] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.697712] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.697916] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 62625c96-6723-456b-bf3c-83161568d0ed is going to be created. [ 1012.725368] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.725605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.725729] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.726454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.726454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.726581] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.978882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.978882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.978882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.979303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.979303] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.979484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.979484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.981705] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.981705] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.981705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.981705] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.127605] env[65381]: INFO networking_nsxv3.common.synchronization [None req-20b3c972-4dc3-4ca5-8d22-97195399680f tempest-ServerActionsV293TestJSON-106956911 tempest-ServerActionsV293TestJSON-106956911-project-member] Enqueued Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_rules [ 1013.128734] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_rules [ 1013.128734] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.128734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.128734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.129057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.129057] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.252155] env[65381]: INFO networking_nsxv3.common.synchronization [None req-d08320e7-c62a-4d9a-a98e-12eb29f2201e tempest-ServerActionsV293TestJSON-106956911 tempest-ServerActionsV293TestJSON-106956911-project-member] Enqueued Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_rules [ 1013.254955] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_rules [ 1013.255520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.255685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.486206] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 1013.506466] env[65381]: INFO networking_nsxv3.common.synchronization [req-98f11543-4c0a-4ef5-989b-06825fff8b3a req-f2ff7bda-0948-4290-8ffe-0e3c9bc119fd service nova] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_rules [ 1013.506633] env[65381]: INFO networking_nsxv3.common.synchronization [req-98f11543-4c0a-4ef5-989b-06825fff8b3a req-f2ff7bda-0948-4290-8ffe-0e3c9bc119fd service nova] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_members [ 1013.506756] env[65381]: INFO networking_nsxv3.common.synchronization [req-98f11543-4c0a-4ef5-989b-06825fff8b3a req-f2ff7bda-0948-4290-8ffe-0e3c9bc119fd service nova] Enqueued Resource ID: 62625c96-6723-456b-bf3c-83161568d0ed with Priority: HIGHEST for action port [ 1013.507339] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_rules [ 1013.507476] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_members [ 1013.507578] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62625c96-6723-456b-bf3c-83161568d0ed with Priority: HIGHEST for action port [ 1013.507860] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.507983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.508068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.508455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.508455] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.509315] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.509435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.509506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.509669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.509827] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.509913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.509954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.510664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.510664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.510664] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.511329] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-62625c96-6723-456b-bf3c-83161568d0ed taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.511442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.511513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.511769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.511854] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62625c96-6723-456b-bf3c-83161568d0ed',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.515080] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.515319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.515408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.515618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.515729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.516009] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.516414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.516507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.516687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.519036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.519036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.519036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.519977] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1013.607400] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.607400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.607400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.607400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.607400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.628023] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1013.680531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.680531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.680531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.680819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.680880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.681998] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 already deleted. [ 1013.681998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.681998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.681998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.681998] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.014057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.014433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.014433] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.022305] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62625c96-6723-456b-bf3c-83161568d0ed with status ACTIVE [ 1014.022751] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.022751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.022751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.023152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.023152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.023228] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.023670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.023670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.023670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.023670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.023851] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.023851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.023981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.024058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.024132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.024290] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62625c96-6723-456b-bf3c-83161568d0ed is going to be updated. [ 1014.051127] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.051268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.051336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.051542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.051681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.053245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62625c96-6723-456b-bf3c-83161568d0ed" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.225586] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.226372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.226548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.226871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.227040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.227168] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 already deleted. [ 1014.227261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.326854] env[65381]: INFO networking_nsxv3.common.synchronization [req-a96b25cd-cade-4d78-a3ae-d919fe7a95c6 req-be154bc6-a2d8-4766-9dce-8caa7a443b46 tempest-ServerRescueTestJSON-1175753319 tempest-ServerRescueTestJSON-1175753319-project-member] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1014.327690] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1014.327826] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.327962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.328077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.328342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.328806] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.328806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.328806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.329068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.329068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.329167] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.519619] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.756737] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.756943] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.757392] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.757729] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.758052] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.758233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.758351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.758671] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.758809] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.759037] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.759155] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.759264] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.759368] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.759474] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.759577] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.759879] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.775399] env[65381]: INFO networking_nsxv3.common.synchronization [None req-b98d6860-0637-41a5-80e9-b9cb4df78aed None None] Enqueued Resource ID: 91463928-116d-45ea-bc24-6c93f1f02e5d with Priority: HIGHEST for action port [ 1014.775399] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91463928-116d-45ea-bc24-6c93f1f02e5d with Priority: HIGHEST for action port [ 1014.775609] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-91463928-116d-45ea-bc24-6c93f1f02e5d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.775682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91463928-116d-45ea-bc24-6c93f1f02e5d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.775846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91463928-116d-45ea-bc24-6c93f1f02e5d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.776386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91463928-116d-45ea-bc24-6c93f1f02e5d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.776386] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91463928-116d-45ea-bc24-6c93f1f02e5d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.785867] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.785977] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.786140] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.786322] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-866" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.786654] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.786784] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.786898] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.787755] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.787755] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6dcb420-3727-42ee-a0b8-edf94a8c97fd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.831682] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.025085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.025521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.025521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.025698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.025698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.025768] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 is going to be created. [ 1015.063545] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.063733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.063781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.064074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.064458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.082747] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: UNINITIALIZED for 2s [ 1015.279331] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91463928-116d-45ea-bc24-6c93f1f02e5d [ 1015.279570] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.279711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.279783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.279999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.280109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.280208] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91463928-116d-45ea-bc24-6c93f1f02e5d already deleted. [ 1015.280292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91463928-116d-45ea-bc24-6c93f1f02e5d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.291487] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.291762] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.291833] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.292203] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.292353] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.292510] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port a6dcb420-3727-42ee-a0b8-edf94a8c97fd not found, creating... [ 1015.292783] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.292973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.293113] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.293443] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.293585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.293919] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.294248] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.294391] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.294655] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.294806] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.295037] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: a6dcb420-3727-42ee-a0b8-edf94a8c97fd is going to be created. [ 1015.320087] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.320422] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.320422] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.320858] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.321197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.321625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.334458] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.646159] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1015.646412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.837135] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.837339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.837411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.837758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.837910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.838212] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be updated. [ 1015.873809] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.873809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.873809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.874425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.874425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.885582] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: IN_PROGRESS for 2s [ 1016.040272] env[65381]: INFO networking_nsxv3.common.synchronization [req-a96b25cd-cade-4d78-a3ae-d919fe7a95c6 req-92317a6e-ecb1-4239-8026-68505c5c2ef3 service nova] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_rules [ 1016.040272] env[65381]: INFO networking_nsxv3.common.synchronization [req-a96b25cd-cade-4d78-a3ae-d919fe7a95c6 req-92317a6e-ecb1-4239-8026-68505c5c2ef3 service nova] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1016.040272] env[65381]: INFO networking_nsxv3.common.synchronization [req-a96b25cd-cade-4d78-a3ae-d919fe7a95c6 req-92317a6e-ecb1-4239-8026-68505c5c2ef3 service nova] Enqueued Resource ID: a6dcb420-3727-42ee-a0b8-edf94a8c97fd with Priority: HIGHEST for action port [ 1016.040969] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_rules [ 1016.040969] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1016.040969] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dcb420-3727-42ee-a0b8-edf94a8c97fd with Priority: HIGHEST for action port [ 1016.041301] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.041486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.041586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.041869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.042007] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.043647] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.043776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.044856] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.044856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.044856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.044856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.044856] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6dcb420-3727-42ee-a0b8-edf94a8c97fd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.547238] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.547396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.547574] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6dcb420-3727-42ee-a0b8-edf94a8c97fd with status ACTIVE [ 1016.547857] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.547857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.548035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.548130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.548222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.548503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.548648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.548750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.548915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.549038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.549268] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.549349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.549349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.549550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.549605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.549687] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6dcb420-3727-42ee-a0b8-edf94a8c97fd is going to be updated. [ 1016.579435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.579435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.579435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.579435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.579435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.579435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6dcb420-3727-42ee-a0b8-edf94a8c97fd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.757204] env[65381]: INFO networking_nsxv3.common.synchronization [req-7ff1d55f-2755-448c-9a17-ec813586fd20 req-e3d8af5f-df36-44e1-91e4-71f359672252 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1016.757767] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1016.758096] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.758224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.758308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.758486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.758640] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.758748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.758807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.758938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.760305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.760508] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.102783] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: SUCCESS [ 1017.102783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.102783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.102783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.102783] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.102783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.103438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.103438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.103438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.103438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.103438] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.126589] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-802 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.126797] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.126923] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.127265] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.127530] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.127689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.127803] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.128014] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.128374] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.128644] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.128788] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.128920] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.129073] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.129217] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.129347] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.129502] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.148505] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.148719] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.148857] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.149044] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-802" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.149361] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-213e6067-eb91-47fe-9267-e7b07fbe156e taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.149530] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.149648] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.149955] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.150105] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213e6067-eb91-47fe-9267-e7b07fbe156e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.264757] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.264757] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.264757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.264757] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 1017.296417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.296417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.296417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.296417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.296417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.306785] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 1017.606511] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.657543] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.657912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.659854] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.659854] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.659854] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.659854] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 213e6067-eb91-47fe-9267-e7b07fbe156e not found, creating... [ 1017.659854] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.659854] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.659854] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.660371] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.660569] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.660992] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.661348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.661571] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.661857] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.662170] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.662285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 213e6067-eb91-47fe-9267-e7b07fbe156e is going to be created. [ 1017.689070] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.689324] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.689686] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.689993] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.690311] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.690594] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.898585] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 1017.898585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.899024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.899161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.899468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.899634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.899742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.899983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.900121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.900265] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.108889] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbd14683-7670-4a2a-a1cd-5d0d61d11e46: rpc.has_security_group_logging(os_id): False [ 1018.131196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.131444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.131444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.132082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.132082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.132236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.132296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.132334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.132513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.132587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.132798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 is going to be created. [ 1018.323728] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.323946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.323946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.324277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.324465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.339969] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: IN_PROGRESS for 2s [ 1018.402840] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.475499] env[65381]: INFO networking_nsxv3.common.synchronization [req-7ff1d55f-2755-448c-9a17-ec813586fd20 req-43b5285d-7220-4ca1-9103-c54c34d7896f service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 1018.475499] env[65381]: INFO networking_nsxv3.common.synchronization [req-7ff1d55f-2755-448c-9a17-ec813586fd20 req-43b5285d-7220-4ca1-9103-c54c34d7896f service nova] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1018.475499] env[65381]: INFO networking_nsxv3.common.synchronization [req-7ff1d55f-2755-448c-9a17-ec813586fd20 req-43b5285d-7220-4ca1-9103-c54c34d7896f service nova] Enqueued Resource ID: 213e6067-eb91-47fe-9267-e7b07fbe156e with Priority: HIGHEST for action port [ 1018.475499] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_rules [ 1018.475499] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1018.475499] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213e6067-eb91-47fe-9267-e7b07fbe156e with Priority: HIGHEST for action port [ 1018.475499] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.475499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.475499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.475499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.475499] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.476456] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.476614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.476766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-213e6067-eb91-47fe-9267-e7b07fbe156e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.476925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.476925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.477277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.477465] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213e6067-eb91-47fe-9267-e7b07fbe156e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.688680] env[65381]: INFO networking_nsxv3.common.synchronization [req-99dbdf1b-e354-4805-bfcc-87d1d220b035 req-635f6183-ad84-47f5-bbe4-30228ec20730 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1018.689611] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1018.690858] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.690858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.690858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.690858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.690858] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.690858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.690858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.690858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.691257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.691257] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.905438] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.979608] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.981294] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 213e6067-eb91-47fe-9267-e7b07fbe156e with status ACTIVE [ 1018.981294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.981294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.981294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.981294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.981788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.981788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.981788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.981788] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.981788] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 213e6067-eb91-47fe-9267-e7b07fbe156e is going to be updated. [ 1019.004709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.004709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.004886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.004961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.005173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.005383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213e6067-eb91-47fe-9267-e7b07fbe156e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.196653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.196653] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.196653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.196653] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1019.224555] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.224671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.224711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.224892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.225236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.235529] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1019.316381] env[65381]: INFO networking_nsxv3.common.synchronization [req-97796017-3f54-4f98-89e8-e3889968e102 req-ef620c4a-0695-4646-860f-8ba1df87577e tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1019.317749] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1019.317749] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.317749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.317749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.318014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.319111] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.319111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.319111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.319111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.319111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.319111] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.321207] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 1019.321488] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 1019.321633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.322134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.322374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.322594] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.322937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.322937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.323063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.323238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.323311] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.408294] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.408556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.408801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.409190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.409480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.409571] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be updated. [ 1019.440403] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.440633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.440776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.441063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.441204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.452202] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: IN_PROGRESS for 2s [ 1019.759978] env[65381]: INFO networking_nsxv3.common.synchronization [req-bb3e6d12-0915-4a34-a95e-06a7fcee9826 req-d81a5b5b-cc27-4233-9bb4-53b0b0b2fd7f tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1019.760623] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1019.761530] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.761727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.761817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.762197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.762430] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.762555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.762687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.762769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.762845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.763024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.825233] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.826474] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.144307] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.144537] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.144686] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.145049] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.145340] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.145522] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.145644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.145882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.146893] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.146893] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.146893] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.146893] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.146893] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.146893] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.146893] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.147315] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.167784] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.167898] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.167942] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.168125] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.168445] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-e5c25c01-0862-43f2-98a1-065ee4c4440e taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.168678] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.168802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.169147] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.169290] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c25c01-0862-43f2-98a1-065ee4c4440e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.265435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.265779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.265779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.266051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.266168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.266408] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.266525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.266585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.266864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.266941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.266982] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b already deleted. [ 1020.267206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.328131] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.329214] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.357120] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: SUCCESS [ 1020.357906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.671924] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.672190] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.672320] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.672602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.672750] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.672902] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port e5c25c01-0862-43f2-98a1-065ee4c4440e not found, creating... [ 1020.673181] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.673395] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.673537] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.673764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.673898] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.674257] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.674533] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.674689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.674897] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.675058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.675210] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: e5c25c01-0862-43f2-98a1-065ee4c4440e is going to be created. [ 1020.699307] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.699519] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.699646] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.699931] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.700224] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.700559] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.832823] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.832823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.832823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.833110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.833110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.833223] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 1020.834782] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.834919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.834971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.835250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.835358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.835474] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1020.880201] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.880469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.880469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.880557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.880842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.882811] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.882961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.883048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.883284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.883469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.898561] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1020.898744] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 1021.247905] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1021.248176] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 1021.248297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.435426] env[65381]: INFO networking_nsxv3.common.synchronization [req-bb3e6d12-0915-4a34-a95e-06a7fcee9826 req-cdb37b25-91d4-4137-b412-5cb9dc22dc73 service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1021.435426] env[65381]: INFO networking_nsxv3.common.synchronization [req-bb3e6d12-0915-4a34-a95e-06a7fcee9826 req-cdb37b25-91d4-4137-b412-5cb9dc22dc73 service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1021.435426] env[65381]: INFO networking_nsxv3.common.synchronization [req-bb3e6d12-0915-4a34-a95e-06a7fcee9826 req-cdb37b25-91d4-4137-b412-5cb9dc22dc73 service nova] Enqueued Resource ID: e5c25c01-0862-43f2-98a1-065ee4c4440e with Priority: HIGHEST for action port [ 1021.435426] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1021.435426] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1021.435426] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c25c01-0862-43f2-98a1-065ee4c4440e with Priority: HIGHEST for action port [ 1021.435426] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.435426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.435426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.436938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.437895] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.439460] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.439581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.439635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.439970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.440154] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.440307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.440409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.440658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.440803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.440957] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.442263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5c25c01-0862-43f2-98a1-065ee4c4440e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.442437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.442537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.442781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.442904] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c25c01-0862-43f2-98a1-065ee4c4440e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.465760] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 1021.466092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.466180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.466406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.466599] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.466728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.466795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.466991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.467088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.467179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.468197] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.945373] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.946500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.946669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.947110] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5c25c01-0862-43f2-98a1-065ee4c4440e with status ACTIVE [ 1021.947249] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.947378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.947511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.947638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.947711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.947896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.948138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.948138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.948517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.948651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.948916] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.949083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.949083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.949257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.949333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.949391] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5c25c01-0862-43f2-98a1-065ee4c4440e is going to be updated. [ 1021.970329] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.970682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.970682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.970984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.971269] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.971432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.971527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.971787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.971976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.972098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.972345] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.972509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.972606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.972900] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.973099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.973233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.973332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.973562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.973697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.973922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.974126] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.976374] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.976558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.976558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.976814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.976814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.976962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5c25c01-0862-43f2-98a1-065ee4c4440e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.448075] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.478664] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e39161d0-dcb4-484d-ae0c-3dc95815f63d: rpc.has_security_group_logging(os_id): False [ 1022.515969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.516414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.516414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.516585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.516635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.517504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.517504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.517504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.517504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.517504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.517504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.517877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.517877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.517877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.517877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.518050] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.518134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.518196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.518342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.518404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.518493] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be updated. [ 1022.590269] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.590500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.590500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.590811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.590957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.609661] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: IN_PROGRESS for 2s [ 1022.911452] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 1022.911677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.911892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.912176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.912717] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.912856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.912957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.914301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.914413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.914511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.914802] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.917264] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1022.917411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.949812] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.950074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.950154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.950378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.950469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.950586] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be created. [ 1022.976418] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.977257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.977380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.977593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.977881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.989515] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: UNINITIALIZED for 2s [ 1023.111145] env[65381]: INFO networking_nsxv3.common.synchronization [req-cd9912fb-bd51-410a-9513-9fc538d47c2b req-7e726b2a-8565-4e8f-88c2-368c92729b98 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1023.111771] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1023.112141] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.112265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.112348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.112612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.112766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.112867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.112964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.113149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.113237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.113331] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.412281] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.412404] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.412445] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.412766] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.413070] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.413247] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.413367] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.413582] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.413724] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.413928] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.414077] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.414352] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.414489] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.415770] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.415770] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.415770] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.418898] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.419039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.419084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.419254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.419407] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.419504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.419566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.419709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.419792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.419878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.420033] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.420129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.420193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.420335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.420472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.420564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.420626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.420778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.421101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.421101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.421101] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.434270] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.435027] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.435027] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.435027] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.435361] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-ab187172-0668-4c43-ab50-6d54f8d53232 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.435593] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.435748] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.436139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.436379] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab187172-0668-4c43-ab50-6d54f8d53232',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.615044] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.615370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.615370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.615643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.615792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.616545] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.616545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.616545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.616545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.616764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.616764] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 already deleted. [ 1023.616998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.923497] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2f08ea40-f56b-4bd5-a0f9-e991cad65528: rpc.has_security_group_logging(os_id): False [ 1023.940579] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.940732] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.941023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.941084] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.941238] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.941423] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port ab187172-0668-4c43-ab50-6d54f8d53232 not found, creating... [ 1023.941755] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.941914] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.942031] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.942369] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.942532] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.943337] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.943337] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.943337] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.943592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.943592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.943666] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: ab187172-0668-4c43-ab50-6d54f8d53232 is going to be created. [ 1023.948416] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.948580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.948651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.948829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.948908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.949128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.949227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.949287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.949442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.949548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.949774] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.949888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.949930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.950094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.950167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.950348] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.950441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.950520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.950636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.950748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.950791] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 1023.993053] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.993053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.993432] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.993657] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.994018] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.994455] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.101463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.101799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.101799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.102119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.102343] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.131666] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 1024.629021] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 1024.629318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.733626] env[65381]: INFO networking_nsxv3.common.synchronization [req-cd9912fb-bd51-410a-9513-9fc538d47c2b req-8cfb01ce-f47d-4653-8e33-867382bbd46d service nova] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1024.738039] env[65381]: INFO networking_nsxv3.common.synchronization [req-cd9912fb-bd51-410a-9513-9fc538d47c2b req-8cfb01ce-f47d-4653-8e33-867382bbd46d service nova] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1024.738039] env[65381]: INFO networking_nsxv3.common.synchronization [req-cd9912fb-bd51-410a-9513-9fc538d47c2b req-8cfb01ce-f47d-4653-8e33-867382bbd46d service nova] Enqueued Resource ID: ab187172-0668-4c43-ab50-6d54f8d53232 with Priority: HIGHEST for action port [ 1024.738039] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1024.738039] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1024.738039] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab187172-0668-4c43-ab50-6d54f8d53232 with Priority: HIGHEST for action port [ 1024.738039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.738039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.738039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.738039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.738039] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.738039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.738039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.738039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.739271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.739673] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.739924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.740457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.740822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.741041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.741247] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.743254] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab187172-0668-4c43-ab50-6d54f8d53232 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.743422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.743504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.743755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.743878] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab187172-0668-4c43-ab50-6d54f8d53232',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.001833] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1025.002121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.002522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.003052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.003052] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.003052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.003194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.003370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.003456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.003526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.003593] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.246396] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.246561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.247084] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.248036] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab187172-0668-4c43-ab50-6d54f8d53232 with status ACTIVE [ 1025.248338] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.248541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.248664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.248979] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.249153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.249463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.249641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.249753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.250038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.250214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.250544] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.250710] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.251051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.251092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.251185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.251277] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab187172-0668-4c43-ab50-6d54f8d53232 is going to be updated. [ 1025.278592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.278801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.278801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.279051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.279271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.279373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.506386] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.506616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.506616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.506702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.506850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.506961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.507042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.507216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.507444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.507444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.507567] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.507646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.507705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.507921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.508156] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.508283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.508348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.508497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.508584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.508706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.508766] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.651174] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9ccf466-4975-419f-a2df-8a24b6694493 req-47c270b0-8bf6-43a4-8860-f45b7d39e2a2 tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_members [ 1025.651944] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_members [ 1025.652406] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.652595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.652691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.652964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.653198] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.653611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.653699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.653902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.653996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.654216] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.754070] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.011790] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e855adc-3508-49b6-b8b1-1007e65b954b: rpc.has_security_group_logging(os_id): False [ 1026.032602] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.032602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.032898] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.032955] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.033256] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.033350] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.036875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.036875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.036875] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.036875] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.036875] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.036875] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.036875] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.036875] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.036875] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.036875] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.036875] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.036875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.036875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.037770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.037770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.037770] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.037770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.037770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.038079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.038262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.038363] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.038363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.038533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.038589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.038639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.038816] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.038902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.038958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.039123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.039182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.039253] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be created. [ 1026.060733] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.060733] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.060733] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.060993] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-52" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.061595] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-64545d83-04c8-4fce-a56c-db63cee85c0f taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.061595] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.061595] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.061976] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.062646] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64545d83-04c8-4fce-a56c-db63cee85c0f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.119383] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.119522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.119594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.120037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.120037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.142927] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1026.151123] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 1026.152102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.156876] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.157218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.157336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.157638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.157744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.158112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.158801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.158801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.158801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.158801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.158801] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d already deleted. [ 1026.158801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.256978] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.257204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.257204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.257443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.257536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.257638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 is going to be created. [ 1026.293438] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.294257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.294411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.295099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.298837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.309287] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: UNINITIALIZED for 2s [ 1026.567629] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.571332] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.571631] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.572115] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.572360] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.572596] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 64545d83-04c8-4fce-a56c-db63cee85c0f not found, creating... [ 1026.573038] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.573387] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.573492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.574146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.574435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.574956] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.575279] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.575526] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.575886] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.576166] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.576443] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 64545d83-04c8-4fce-a56c-db63cee85c0f is going to be created. [ 1026.597250] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.597481] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.597603] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.597880] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.599480] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.599480] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.309244] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9ccf466-4975-419f-a2df-8a24b6694493 req-01d29f01-001b-49ab-b866-940a9fb6d50b service nova] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_rules [ 1027.309600] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9ccf466-4975-419f-a2df-8a24b6694493 req-01d29f01-001b-49ab-b866-940a9fb6d50b service nova] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_members [ 1027.309747] env[65381]: INFO networking_nsxv3.common.synchronization [req-a9ccf466-4975-419f-a2df-8a24b6694493 req-01d29f01-001b-49ab-b866-940a9fb6d50b service nova] Enqueued Resource ID: 64545d83-04c8-4fce-a56c-db63cee85c0f with Priority: HIGHEST for action port [ 1027.310624] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_rules [ 1027.310624] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_members [ 1027.310773] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64545d83-04c8-4fce-a56c-db63cee85c0f with Priority: HIGHEST for action port [ 1027.311116] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.311116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.311356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.311458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.311544] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.312814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.312814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.313049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.313049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.313462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.313462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.313462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.314294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.314294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.314294] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.314607] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-64545d83-04c8-4fce-a56c-db63cee85c0f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.314720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.314720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.316412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.316412] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64545d83-04c8-4fce-a56c-db63cee85c0f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.816991] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.818230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.818230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.818230] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64545d83-04c8-4fce-a56c-db63cee85c0f with status ACTIVE [ 1027.818743] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.818743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.818743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.818934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.819036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.819203] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.819300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.819609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.819609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.819734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.819826] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.819919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.820041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.820214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.820295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.820394] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64545d83-04c8-4fce-a56c-db63cee85c0f is going to be updated. [ 1027.846552] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.846713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.846792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.847010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.847158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.847355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64545d83-04c8-4fce-a56c-db63cee85c0f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.159917] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1028.159917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.324024] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: SUCCESS [ 1028.324024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.324024] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.324024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.324024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.324024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.324024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.324024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.325084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.325359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.325582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.325780] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.829027] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.829027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.829027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.829027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.829027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.829027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d is going to be created. [ 1028.829897] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.853489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.853671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.853721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.853905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.854076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.865336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d13ab4e4-01d1-4513-ab86-141d5851283d in Status: UNINITIALIZED for 2s [ 1029.333683] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5ab19d-0519-49e0-95a2-457ebf3b46a0: rpc.has_security_group_logging(os_id): False [ 1029.356761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.356937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.357859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.357859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.357859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.357859] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.358144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.358144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.358244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.358295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.358405] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 is going to be created. [ 1029.418487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.418751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.418821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.419122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.419420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.431874] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: IN_PROGRESS for 2s [ 1030.878428] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d13ab4e4-01d1-4513-ab86-141d5851283d in Status: SUCCESS [ 1030.878428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.878731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.878731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.879340] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.879340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.879340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.879340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.880244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.880244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.880244] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.383130] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.446909] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: SUCCESS [ 1031.447200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.886485] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d13ab4e4-01d1-4513-ab86-141d5851283d: rpc.has_security_group_logging(os_id): False [ 1031.905025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.905223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.905315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.905604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.905649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.905973] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.906135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.906234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.906456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.906569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.906639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d is going to be created. [ 1031.973214] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.973412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.973463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.973660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.973930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.992140] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d13ab4e4-01d1-4513-ab86-141d5851283d in Status: IN_PROGRESS for 2s [ 1032.312030] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1032.312228] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1034.008075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d13ab4e4-01d1-4513-ab86-141d5851283d in Status: SUCCESS [ 1034.008450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.660880] env[65381]: INFO networking_nsxv3.common.synchronization [req-07fc6b16-397a-4c75-8f5a-7eded999ec1f req-41dd32ac-1eea-4961-932a-24ef78f2f644 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1034.661432] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1034.661763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.661881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.662563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.665626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.665908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.666082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.666082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.666201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.666289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.666403] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.168652] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.168954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.168954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.169718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.169718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.169718] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.169718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.169718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.169718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.170171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.170171] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1035.204544] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.204998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.204998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.204998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.205617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.217028] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1037.229630] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1037.229990] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b deletion is rescheduled due to dependency. [ 1037.229990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.593463] env[65381]: INFO networking_nsxv3.common.synchronization [req-5b285f5f-b78e-4d09-ac53-f70a035ceb18 req-27a13c89-1469-4218-aa94-e452c1ebfca1 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1037.593463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1037.596448] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.596448] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.596448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.596448] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.969020] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.969020] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.969020] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.969020] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.969485] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.969771] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.969993] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.970327] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.970677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.971027] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.972328] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.972328] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.972328] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.972328] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.972328] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.972328] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.995408] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.995575] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.995725] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.995896] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.996233] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-f2b23032-dafd-4c7b-a76f-b03726cd624f taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.996409] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.996532] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.996849] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.996986] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b23032-dafd-4c7b-a76f-b03726cd624f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.101379] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.101573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.101648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.101819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.101911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.102117] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.102231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.102322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.102488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.102557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.102672] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1038.137067] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.137224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.137296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.137511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.137694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.148977] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1038.382213] env[65381]: INFO networking_nsxv3.common.synchronization [req-bf499f1e-7847-4f95-8480-48b55144e18a req-eb190d42-b1e7-4163-9a06-35a9f4449c3f tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_members [ 1038.382955] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGHEST for action security_group_members [ 1038.383451] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.383655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.383783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.384145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.384394] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.384545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.384637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.384881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.385018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.385165] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.499816] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.500116] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.500250] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.500562] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.500952] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.500999] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port f2b23032-dafd-4c7b-a76f-b03726cd624f not found, creating... [ 1038.501321] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.501519] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.501658] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.501929] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.502127] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.502574] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.502780] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.502961] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.503294] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.503437] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.503581] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: f2b23032-dafd-4c7b-a76f-b03726cd624f is going to be created. [ 1038.527547] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.527997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.527997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.528216] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.528376] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.528616] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.762544] env[65381]: INFO networking_nsxv3.common.synchronization [req-02134034-12a1-4e47-82b6-d1135331ffb0 req-d581554c-4495-4089-967f-c74f3cbeb421 tempest-ImagesTestJSON-71161681 tempest-ImagesTestJSON-71161681-project-member] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1038.765252] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGHEST for action security_group_members [ 1038.765979] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.766174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.766268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.766534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.766745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.766893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.766984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.767184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.767296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.767419] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.887660] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.887848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.887891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.888142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.913808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.914151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.914382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.914470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.914735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.914869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.915034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf is going to be updated. [ 1038.944483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.945350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.945350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.945479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.945822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.956178] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf in Status: IN_PROGRESS for 2s [ 1039.241608] env[65381]: INFO networking_nsxv3.common.synchronization [req-5b285f5f-b78e-4d09-ac53-f70a035ceb18 req-36ead725-c630-4b98-ada9-46a08ef000c6 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 1039.241732] env[65381]: INFO networking_nsxv3.common.synchronization [req-5b285f5f-b78e-4d09-ac53-f70a035ceb18 req-36ead725-c630-4b98-ada9-46a08ef000c6 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1039.241781] env[65381]: INFO networking_nsxv3.common.synchronization [req-5b285f5f-b78e-4d09-ac53-f70a035ceb18 req-36ead725-c630-4b98-ada9-46a08ef000c6 service nova] Enqueued Resource ID: f2b23032-dafd-4c7b-a76f-b03726cd624f with Priority: HIGHEST for action port [ 1039.242282] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 1039.242514] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1039.242514] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2b23032-dafd-4c7b-a76f-b03726cd624f with Priority: HIGHEST for action port [ 1039.245906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.245906] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.245906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.245906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2b23032-dafd-4c7b-a76f-b03726cd624f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.245906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.245906] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2b23032-dafd-4c7b-a76f-b03726cd624f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.270020] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.270020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.270020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.270341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.270341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.270341] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.270475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.270475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.273611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.273611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.273611] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be updated. [ 1039.298456] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.298456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.298631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.298776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.300045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.309699] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: IN_PROGRESS for 2s [ 1039.749650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.749650] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2b23032-dafd-4c7b-a76f-b03726cd624f with status ACTIVE [ 1039.749650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.749650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.749650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.749650] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.750536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.750536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.750536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.751041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.751289] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2b23032-dafd-4c7b-a76f-b03726cd624f is going to be updated. [ 1039.789921] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.790091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.790265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.790552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.791150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.791150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2b23032-dafd-4c7b-a76f-b03726cd624f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.105889] env[65381]: INFO networking_nsxv3.common.synchronization [req-6fcb399b-a7ce-4581-bba0-1396a65c57ac req-b6ba7928-3cca-4418-b807-6e46e6a0bf5d tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1040.106542] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1040.107275] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.107425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.107510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.107654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.108098] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.108098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.108098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.108322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.108322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.108431] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.161275] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1040.163976] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.163976] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.163976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.163976] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.458369] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.458565] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.459086] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.459376] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.459646] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.459812] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.459930] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.460161] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.460307] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.460523] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.460634] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.460748] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.460856] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.460971] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.461094] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.461227] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.486782] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.487120] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.487229] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.487350] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.487697] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-18949c18-d0b6-492d-a709-e115315f36e5 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.487894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.488035] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.488389] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.488549] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18949c18-d0b6-492d-a709-e115315f36e5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.610882] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.666324] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.966617] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf in Status: SUCCESS [ 1040.967129] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf deletion is rescheduled due to dependency. [ 1040.967129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.991067] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.991423] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.991606] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.991928] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.992123] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.992316] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 18949c18-d0b6-492d-a709-e115315f36e5 not found, creating... [ 1040.992617] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.992809] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.992967] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.993247] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.993455] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.993861] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.994059] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.994250] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.994587] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.994754] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.994922] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 18949c18-d0b6-492d-a709-e115315f36e5 is going to be created. [ 1041.015683] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.015917] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.016029] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.016304] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.016531] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.017016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.114690] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.168378] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.321510] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 in Status: SUCCESS [ 1041.321944] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 deletion is rescheduled due to dependency. [ 1041.322094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.622026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.622026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.622026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.622026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.622026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.622026] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1041.665620] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.665863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.665863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.666046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.666192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.671048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.671558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.671558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.671793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.672088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.672088] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1041.680198] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1041.703191] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.703409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.703464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.703755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.703914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.715657] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1041.777310] env[65381]: INFO networking_nsxv3.common.synchronization [req-6fcb399b-a7ce-4581-bba0-1396a65c57ac req-da0395b8-ac66-4147-b177-4f2c58bf4522 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1041.777497] env[65381]: INFO networking_nsxv3.common.synchronization [req-6fcb399b-a7ce-4581-bba0-1396a65c57ac req-da0395b8-ac66-4147-b177-4f2c58bf4522 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1041.778016] env[65381]: INFO networking_nsxv3.common.synchronization [req-6fcb399b-a7ce-4581-bba0-1396a65c57ac req-da0395b8-ac66-4147-b177-4f2c58bf4522 service nova] Enqueued Resource ID: 18949c18-d0b6-492d-a709-e115315f36e5 with Priority: HIGHEST for action port [ 1041.778675] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1041.778843] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1041.778946] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18949c18-d0b6-492d-a709-e115315f36e5 with Priority: HIGHEST for action port [ 1041.779336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.779608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.779608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.780026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.780026] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.781492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.781658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.781933] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-18949c18-d0b6-492d-a709-e115315f36e5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.782207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.782324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.782581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.782714] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18949c18-d0b6-492d-a709-e115315f36e5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.104035] env[65381]: INFO networking_nsxv3.common.synchronization [req-32e792d7-8869-4e18-9914-a1e95c39bed3 req-f8f642ff-501e-4367-bbf6-47037f1e90d1 tempest-ServerRescueTestJSON-1175753319 tempest-ServerRescueTestJSON-1175753319-project-member] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1042.104946] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1042.105287] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.105419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.105486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.105680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.105827] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.105921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.105984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.106144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.106229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.106342] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.286049] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.286218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.286385] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18949c18-d0b6-492d-a709-e115315f36e5 with status ACTIVE [ 1042.286556] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.286863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.286863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.287033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.287138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.287319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.287475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.287552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.287797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.287888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.288093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.288192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.288255] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.288462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.288462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.288536] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18949c18-d0b6-492d-a709-e115315f36e5 is going to be updated. [ 1042.310223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.310405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.310449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.310663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.310821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.311066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18949c18-d0b6-492d-a709-e115315f36e5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.608212] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.112399] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.614927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.615112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.615188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.615428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.615554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.615665] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be updated. [ 1043.653951] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.653951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.653951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.653951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.654249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668487] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: IN_PROGRESS for 2s [ 1043.691271] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1043.691527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.691706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.691922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.692143] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.692264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.692316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.692589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.692589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.692682] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.737060] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1043.737060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.737060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.737060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.737060] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.737643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.737643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.737643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.737643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.737643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.737643] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.195623] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.240240] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.240877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.240877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.241216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.241297] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.241461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.241608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.241912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.242016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.242169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.242401] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.242582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.242830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.242830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.243051] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.243135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.243135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.243252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.243342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.243497] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.243665] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.545666] env[65381]: INFO networking_nsxv3.common.synchronization [req-91e30669-5a52-4fde-a838-99bde725a130 req-496897df-2b2f-420b-a253-a56e2bc650dc tempest-ServerActionsV293TestJSON-106956911 tempest-ServerActionsV293TestJSON-106956911-project-member] Enqueued Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_members [ 1044.546254] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_members [ 1044.546631] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.546789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.546862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.548712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.548894] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.548990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.549458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.549458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.549458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.549458] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.699531] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.746319] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a23f96-505a-4b63-87f3-5175bacc51ab: rpc.has_security_group_logging(os_id): False [ 1044.767145] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.767366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.767986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.767986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.767986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.768313] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.768490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.768615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.768901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.769016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.769689] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.769895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.769932] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.770187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.770324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.770641] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.770822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.770966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.771153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.771268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.771386] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1044.881896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.882172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.882304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.882618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.882806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.916323] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1044.937584] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-112 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.937995] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.938233] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.938725] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.939191] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.939470] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.939816] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.940348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.940585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.941028] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.941158] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.941353] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.941538] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.941743] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.941933] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.942199] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.971533] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.971765] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.971993] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.972289] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-112" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.972774] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.973054] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.973256] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.973732] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.973955] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa22eb4-03ec-47cd-b44a-758dea85a6e1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.051922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.052138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.052138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.052410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.052531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.052829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.052975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.052975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.053143] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.053215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.053297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 already deleted. [ 1045.053376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.202342] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.202663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.202663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.202777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.202839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.202939] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1045.232856] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.232992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.233097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.233306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.233451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.244075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1045.479518] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.479518] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port ffa22eb4-03ec-47cd-b44a-758dea85a6e1 not found, creating... [ 1045.479518] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.479518] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.480243] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.480243] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.480243] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.480676] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.480917] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.481164] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: ffa22eb4-03ec-47cd-b44a-758dea85a6e1 is going to be created. [ 1045.503726] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.507016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.507016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.507016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.507016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.507016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.680676] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 1045.681084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.223977] env[65381]: INFO networking_nsxv3.common.synchronization [req-91e30669-5a52-4fde-a838-99bde725a130 req-53924339-6478-4ceb-9cac-d9c519f8f62c service nova] Enqueued Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_rules [ 1046.224269] env[65381]: INFO networking_nsxv3.common.synchronization [req-91e30669-5a52-4fde-a838-99bde725a130 req-53924339-6478-4ceb-9cac-d9c519f8f62c service nova] Enqueued Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_members [ 1046.224363] env[65381]: INFO networking_nsxv3.common.synchronization [req-91e30669-5a52-4fde-a838-99bde725a130 req-53924339-6478-4ceb-9cac-d9c519f8f62c service nova] Enqueued Resource ID: ffa22eb4-03ec-47cd-b44a-758dea85a6e1 with Priority: HIGHEST for action port [ 1046.224951] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_rules [ 1046.225115] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_members [ 1046.225217] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffa22eb4-03ec-47cd-b44a-758dea85a6e1 with Priority: HIGHEST for action port [ 1046.225540] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.225664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.225730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.226336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.226336] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.227050] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.227178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.227306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.227415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.227560] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.227659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.227739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.227859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.227945] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.228044] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.229247] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.229247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.229394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.229476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.229811] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffa22eb4-03ec-47cd-b44a-758dea85a6e1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.733481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.733481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.733481] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.733481] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ffa22eb4-03ec-47cd-b44a-758dea85a6e1 with status ACTIVE [ 1046.733481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.733481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.733481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.733481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.733481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.733481] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.734286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.734286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.734286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.734286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.734569] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.734569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.734739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.735024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.735024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.735136] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ffa22eb4-03ec-47cd-b44a-758dea85a6e1 is going to be updated. [ 1046.759243] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.759479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.759532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.759720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.759997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.760153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffa22eb4-03ec-47cd-b44a-758dea85a6e1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.931852] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1046.932217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.963816] env[65381]: INFO networking_nsxv3.common.synchronization [None req-47de8bbe-d9ec-422c-9cbe-be73147cd485 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_rules [ 1046.964042] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_rules [ 1046.964518] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.964867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.964867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.965306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.965397] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.051104] env[65381]: INFO networking_nsxv3.common.synchronization [None req-83b4a162-7571-4875-a499-86589213f7e5 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_rules [ 1047.051321] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_rules [ 1047.051642] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.051745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.239466] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.257755] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1047.257990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.260046] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.260046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.260046] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.488726] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.488923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.488984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.489277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.489419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.489569] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 already deleted. [ 1047.489708] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.489949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.490216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.490359] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.742157] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.742346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.742503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.742718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.742809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.742913] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 is going to be created. [ 1047.762498] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.763114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.763114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.763114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.763298] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.763370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.763412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.763836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.763836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.763836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.763992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.764078] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.764162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.764647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.764647] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.764647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.764822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.764925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.764964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.765093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.765164] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.772022] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.772240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.772338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.772834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.773076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.794271] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb494464-5516-45a4-9361-f2c93b57fef6 in Status: UNINITIALIZED for 2s [ 1048.013426] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.013579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.013647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.013863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.013950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.014060] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 already deleted. [ 1048.014145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.268594] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 1048.290597] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.290784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.290850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.291088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.291183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.291406] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.291506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.291572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.291739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.291830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.292091] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.292190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.292251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.292395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.292469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.292666] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.292809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.292855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.292976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.293060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.293146] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1048.359400] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.359646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.359775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.360107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.360338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.381549] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1049.808793] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb494464-5516-45a4-9361-f2c93b57fef6 in Status: SUCCESS [ 1049.809187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.810944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.810944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.811138] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.811246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.811329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.811472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.811553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.811654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.811749] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.316084] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.402101] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1050.402548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.819735] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb494464-5516-45a4-9361-f2c93b57fef6: rpc.has_security_group_logging(os_id): False [ 1050.845727] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.845910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.845963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.846221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.846306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.846563] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.846668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.846733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.846891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.846964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.847064] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 is going to be created. [ 1050.945547] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.945727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.945787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.945993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.946175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.958225] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb494464-5516-45a4-9361-f2c93b57fef6 in Status: IN_PROGRESS for 2s [ 1052.052287] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1052.052287] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1052.478258] env[65381]: INFO networking_nsxv3.common.synchronization [req-9e6322e4-9702-4426-b0ec-b8d0bbcc3049 req-8e719fdf-b36d-4070-b100-791d0db63d4d tempest-ServerRescueTestJSON-1175753319 tempest-ServerRescueTestJSON-1175753319-project-member] Enqueued Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1052.478918] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d with Priority: HIGHEST for action security_group_members [ 1052.479308] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-e39161d0-dcb4-484d-ae0c-3dc95815f63d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.479487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.482028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.482269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.482436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.482652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.482725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.482883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.482963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.483073] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e39161d0-dcb4-484d-ae0c-3dc95815f63d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.979905] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb494464-5516-45a4-9361-f2c93b57fef6 in Status: SUCCESS [ 1052.980182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.987638] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.987638] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.987638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.987638] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d is going to be updated. [ 1053.019460] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.019657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.019715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.019904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.020066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.032958] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: IN_PROGRESS for 2s [ 1054.918989] env[65381]: INFO networking_nsxv3.common.synchronization [req-401e39ce-3fd3-4dca-b011-00d4ad322332 req-019684b8-0c69-4c30-af72-25af5d111231 tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1054.919482] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1054.920224] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.921094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.921094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.921094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.921714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.921838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.921944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.922152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.922319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.922909] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.044407] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d in Status: SUCCESS [ 1055.044636] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e39161d0-dcb4-484d-ae0c-3dc95815f63d deletion is rescheduled due to dependency. [ 1055.044777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e39161d0-dcb4-484d-ae0c-3dc95815f63d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.424841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.425165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.425328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.425723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.425940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.426300] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.426519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.426643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.426926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.427084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.427241] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1055.458058] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.458058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.458058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.458058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.458058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.467813] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1056.521092] env[65381]: INFO networking_nsxv3.common.synchronization [req-d336c8cc-433e-48d7-800b-7a126cb97e2b req-c4762939-c39c-4928-a6fc-60ba6dc916ed tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1056.521744] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1056.521966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.522108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.522200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.523162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.523162] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.523162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.523162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.523162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.523162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.523162] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.895746] env[65381]: INFO networking_nsxv3.common.synchronization [req-9d119160-fab9-4532-b0cc-b38adb675426 req-9027e603-7c20-4459-a4bf-b786919a4089 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_members [ 1056.899134] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_members [ 1056.899134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.899134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.899134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.899134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.899134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.899134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.899465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.899465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.899616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.899777] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.026487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.026487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.026487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.026487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.026487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.026487] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.026795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.026795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.026795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.026905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.026955] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 1057.059505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.059505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.059505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.059505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.059505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.067673] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 1057.233965] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.233965] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.234226] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.234587] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.235032] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.235309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.235524] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.236055] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.236318] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.236650] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.236869] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.237117] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.237343] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.237559] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.237762] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.238013] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.259811] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.260144] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.260397] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.260660] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.261131] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-dff9ab03-c00f-49d6-b1da-fce563808bc1 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.261416] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.261608] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.262058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.262292] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dff9ab03-c00f-49d6-b1da-fce563808bc1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.402531] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.402779] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.402897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.403165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.403272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.403468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.403570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.403678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.403789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.403866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.403951] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 already deleted. [ 1057.404044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.477923] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1057.478158] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 1057.478271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.764820] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.765259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.765259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.765565] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.765791] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.765995] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port dff9ab03-c00f-49d6-b1da-fce563808bc1 not found, creating... [ 1057.766314] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.766535] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.766682] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.766971] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.767139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.767470] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.767674] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.767798] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.768026] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.768163] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.768304] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: dff9ab03-c00f-49d6-b1da-fce563808bc1 is going to be created. [ 1057.799744] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.800017] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.800154] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.800474] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.800703] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.800930] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.500370] env[65381]: INFO networking_nsxv3.common.synchronization [req-9d119160-fab9-4532-b0cc-b38adb675426 req-148c7440-0fad-470d-ad77-5e11f0320ddc service nova] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_rules [ 1058.500553] env[65381]: INFO networking_nsxv3.common.synchronization [req-9d119160-fab9-4532-b0cc-b38adb675426 req-148c7440-0fad-470d-ad77-5e11f0320ddc service nova] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_members [ 1058.500672] env[65381]: INFO networking_nsxv3.common.synchronization [req-9d119160-fab9-4532-b0cc-b38adb675426 req-148c7440-0fad-470d-ad77-5e11f0320ddc service nova] Enqueued Resource ID: dff9ab03-c00f-49d6-b1da-fce563808bc1 with Priority: HIGHEST for action port [ 1058.501263] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_rules [ 1058.501384] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_members [ 1058.501432] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dff9ab03-c00f-49d6-b1da-fce563808bc1 with Priority: HIGHEST for action port [ 1058.501730] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.501914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.501914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.502146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.502232] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.503333] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.503333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.503333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.503572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.503572] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.503660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.503707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.503846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.503928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.504110] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.504794] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-dff9ab03-c00f-49d6-b1da-fce563808bc1 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.504921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.504974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.505215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.505215] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dff9ab03-c00f-49d6-b1da-fce563808bc1',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.007097] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.007097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.007598] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.008426] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dff9ab03-c00f-49d6-b1da-fce563808bc1 with status ACTIVE [ 1059.008426] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.008639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.008639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.008863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.008863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.009073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.009154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.009262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.009346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.009425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.009604] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.009697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.009750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.009892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.009962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.010660] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dff9ab03-c00f-49d6-b1da-fce563808bc1 is going to be updated. [ 1059.031450] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.031908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.031982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.032203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.032340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.032539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dff9ab03-c00f-49d6-b1da-fce563808bc1" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.088562] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1059.088746] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 1059.088859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.512470] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.015092] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.015463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.015463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.015590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.015743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.015840] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 is going to be created. [ 1060.040221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.040389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.040526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.040777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.040997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.050429] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 in Status: UNINITIALIZED for 2s [ 1060.243073] env[65381]: INFO networking_nsxv3.common.synchronization [req-e96aa883-67a1-4bdc-94c9-1a5caba900ec req-bc17c417-d862-4524-a730-dd879c3ac1b9 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1060.243073] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1060.243073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.243073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.243073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.243073] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.547567] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.547830] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.547993] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.548351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.548626] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.548805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.548974] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.549280] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.549462] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.549674] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.549801] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.549921] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.550045] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.550188] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.550341] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.550504] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.574395] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.574562] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.574724] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.575052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.575414] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-ca5c27e8-0f02-44a5-a713-fd416265c5ee taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.575646] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.575837] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.576394] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.576394] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca5c27e8-0f02-44a5-a713-fd416265c5ee',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.747471] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.079222] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.079708] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.079708] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.079925] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.080107] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.080264] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port ca5c27e8-0f02-44a5-a713-fd416265c5ee not found, creating... [ 1061.080547] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.080720] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.080838] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.081147] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.081325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.081641] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.081805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.081923] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.082163] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.082296] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.082445] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: ca5c27e8-0f02-44a5-a713-fd416265c5ee is going to be created. [ 1061.104627] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.104958] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.105100] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.105526] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.105592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.105997] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.253495] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.756207] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.756412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.756412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.756599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.756688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.756789] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1061.786242] env[65381]: INFO networking_nsxv3.common.synchronization [req-e96aa883-67a1-4bdc-94c9-1a5caba900ec req-997d1518-10c0-4517-a0ba-13240b555fd0 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1061.786516] env[65381]: INFO networking_nsxv3.common.synchronization [req-e96aa883-67a1-4bdc-94c9-1a5caba900ec req-997d1518-10c0-4517-a0ba-13240b555fd0 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1061.786624] env[65381]: INFO networking_nsxv3.common.synchronization [req-e96aa883-67a1-4bdc-94c9-1a5caba900ec req-997d1518-10c0-4517-a0ba-13240b555fd0 service nova] Enqueued Resource ID: ca5c27e8-0f02-44a5-a713-fd416265c5ee with Priority: HIGHEST for action port [ 1061.787761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.787917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.788041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.788168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.788311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.789657] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1061.789835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1061.789835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca5c27e8-0f02-44a5-a713-fd416265c5ee with Priority: HIGHEST for action port [ 1061.790693] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.790827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.790877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.791086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.791203] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.792102] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.792202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.792397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca5c27e8-0f02-44a5-a713-fd416265c5ee taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.792509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.792606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.792749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.792824] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca5c27e8-0f02-44a5-a713-fd416265c5ee',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.803533] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1062.060525] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 in Status: SUCCESS [ 1062.060783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.060915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.061338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.061458] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.061575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.061575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.061686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.061818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.061895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.062158] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.294896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.295316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.295316] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca5c27e8-0f02-44a5-a713-fd416265c5ee with status ACTIVE [ 1062.295414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.295468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.295508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.295745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.295870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.296102] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.296209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.296275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.296450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.296532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.296713] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.296810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.296870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.297027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.297095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.297179] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca5c27e8-0f02-44a5-a713-fd416265c5ee is going to be updated. [ 1062.318373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.318517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.318580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.318848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.318954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.319136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca5c27e8-0f02-44a5-a713-fd416265c5ee" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.563931] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.066635] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 589d1cd6-9e5a-4c7a-91aa-0a588632eb00: rpc.has_security_group_logging(os_id): False [ 1063.089594] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.089753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.089836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.090315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.090315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.090431] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.090551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.090618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.090840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.090937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.091039] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 is going to be created. [ 1063.153802] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.153802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.153802] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.154187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.154187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.167723] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 in Status: IN_PROGRESS for 2s [ 1063.617382] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.617382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.617382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.617382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.617382] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.821934] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1063.822195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.822379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.822736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.822830] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.822971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.823043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.823171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.823255] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.823357] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.118965] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.326468] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.621681] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.830232] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.124399] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1065.124523] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1065.179041] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 in Status: SUCCESS [ 1065.179301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.332459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.332626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.332707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.332953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.333062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.333167] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1065.375514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.375673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.375792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.376054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.376217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.389346] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1066.030257] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.030542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.030542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.030710] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.043428] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1066.046371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.047385] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1066.086354] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.086630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.086630] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.086810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.096509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.097291] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1066.097386] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.097586] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1066.144275] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.144523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.144523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.144718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.146491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.146757] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1066.232825] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.233090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.233090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.233366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.233705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.234027] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1066.330204] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.330468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.330585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.330824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.331169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.331578] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1066.331757] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fb70f39c-753b-4f89-a31c-4120096fef6d', '6e855adc-3508-49b6-b8b1-1007e65b954b', '23475551-8968-4429-bd3c-c9fca786a07e', 'c9c03ef0-b5e2-4757-9488-6558cc6e9841', '4b4a90f8-0f8d-4a72-a1ab-081e60de92bf', '4f7edcc5-73dd-4323-8612-25595c2370aa', '9694af19-2e42-4299-8799-3ccc40da653d', 'bbd14683-7670-4a2a-a1cd-5d0d61d11e46', '34a23f96-505a-4b63-87f3-5175bacc51ab', '5e525ee2-71eb-4b6c-8d4b-ec2247632bbc', 'c0309f4f-d87e-4e36-bcfb-dc749a00a108', '915a6b47-7bba-4851-9dc7-06e0692a5259', 'ca1b5748-90c1-473a-ab4f-767cc4ab05d7', '0e917637-f523-43f9-9811-f2b68b364eb6', '6ea7ac34-a800-4898-bb50-0dd416be04d0', 'a824681a-154e-415a-8473-76ea98ebc45a', '784f4514-1cec-43fd-97c8-9a7ad1576b94', 'f4bef8d2-2573-40a3-9fa1-478fba08e217', 'ca937f1d-ad54-42e4-88d0-5a460de400c2', '1845664f-8bfa-4c5b-b1d8-5f3082db2137', '2380b72e-771a-447f-bf96-4a7738880121', '6413c0f9-b937-44ab-ae61-b7613757b3e9', '589d1cd6-9e5a-4c7a-91aa-0a588632eb00', '8b58c566-5d76-43c3-8ec7-fbe48a220f7a', '993d6955-5d35-45d8-9907-eba6ec8a9076', 'c007b86e-f555-43b0-9e5a-60b1b4faffb3', '2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b', 'd5417c42-09b8-4d6e-a6e5-4941c3e00ca9', '40be60f5-b915-4038-8a92-b31ab9bbba3e', '39a58ced-f936-4d85-96d1-2772060a7aae', '0e6956fc-e986-4223-b0b3-c4fabc7eb8cf', '2fa502cc-eee4-43e5-bf7a-e5551fb38a40', '46372329-aee9-4feb-9469-adefbb727cb5', '51eca9de-71e7-42ac-8af4-13f26cb274bd', '274f904b-e458-4b4b-9611-3ae0669bc24b', '5e5ab19d-0519-49e0-95a2-457ebf3b46a0', '61c2d48d-c321-4e23-999d-809958401c70', 'b495a081-8211-4db6-af3d-10fc0b2f521c', '007dd7b5-b0ce-46da-9cc3-86f074d0bbdb', 'a5deaafa-85eb-41da-90a6-8945218fb5f5', '48eacb50-df32-446c-947a-a00fbf576caa', '2f08ea40-f56b-4bd5-a0f9-e991cad65528', 'd13ab4e4-01d1-4513-ab86-141d5851283d', 'cb494464-5516-45a4-9361-f2c93b57fef6', '6b334e63-c2b8-4d02-9110-c8fc60d33c13', 'bb17e366-3b38-46cd-836a-5d640fa33c5a', '6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61', '5819134c-7e49-4e7e-b983-fb61c5b540ad', '0109d178-d310-4d94-9ce8-74560a55bfa3', 'e39161d0-dcb4-484d-ae0c-3dc95815f63d'} {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.331918] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1066.360850] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.361142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.361142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.362013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.362013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.362013] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1066.362013] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.362013] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1066.441504] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.441799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.441799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.442919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.444166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.444166] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1066.444166] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.444166] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1066.444166] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1066.444166] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1066.444166] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGH for action security_group_rules [ 1066.444166] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGH for action security_group_rules [ 1066.444166] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGH for action security_group_rules [ 1066.444603] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGH for action security_group_rules [ 1066.444997] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGH for action security_group_rules [ 1066.444997] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGH for action security_group_rules [ 1066.444997] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGH for action security_group_rules [ 1066.444997] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGH for action security_group_rules [ 1066.444997] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGH for action security_group_rules [ 1066.445221] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGH for action security_group_rules [ 1066.445221] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGH for action security_group_rules [ 1066.445221] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGH for action security_group_rules [ 1066.445221] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGH for action security_group_rules [ 1066.445351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb70f39c-753b-4f89-a31c-4120096fef6d with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23475551-8968-4429-bd3c-c9fca786a07e with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e917637-f523-43f9-9811-f2b68b364eb6 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824681a-154e-415a-8473-76ea98ebc45a with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f7edcc5-73dd-4323-8612-25595c2370aa with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGH for action security_group_rules [ 1066.793803] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb70f39c-753b-4f89-a31c-4120096fef6d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.793803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.793803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.793803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.793803] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb70f39c-753b-4f89-a31c-4120096fef6d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.795140] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23475551-8968-4429-bd3c-c9fca786a07e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.795140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.795140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.795140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795140] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23475551-8968-4429-bd3c-c9fca786a07e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.796032] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.796032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.796223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.796525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.796525] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.798889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.799044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.799114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.799304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.799385] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.800249] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.800367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.800433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.800693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.800693] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1845664f-8bfa-4c5b-b1d8-5f3082db2137',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.801501] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca937f1d-ad54-42e4-88d0-5a460de400c2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.801576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.801643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.801800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.801877] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca937f1d-ad54-42e4-88d0-5a460de400c2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.802712] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4bef8d2-2573-40a3-9fa1-478fba08e217 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.802847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.802917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.803137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.803185] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4bef8d2-2573-40a3-9fa1-478fba08e217',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.804071] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.804139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.804208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.805288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.805371] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.806854] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e917637-f523-43f9-9811-f2b68b364eb6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.806934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.807168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.807251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.807330] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e917637-f523-43f9-9811-f2b68b364eb6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.808928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a824681a-154e-415a-8473-76ea98ebc45a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.809222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.809259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.809405] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.809476] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a824681a-154e-415a-8473-76ea98ebc45a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.811103] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.811224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.811292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.811495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.811545] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca1b5748-90c1-473a-ab4f-767cc4ab05d7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.812262] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.814146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.814146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.814146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.814146] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.814146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.814146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.814146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.814596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.814596] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.814990] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.815111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.815175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.815331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.815402] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e525ee2-71eb-4b6c-8d4b-ec2247632bbc',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.816260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.816370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.816437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.816586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.816657] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.817320] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f7edcc5-73dd-4323-8612-25595c2370aa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.817429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.817529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.817878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.817946] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f7edcc5-73dd-4323-8612-25595c2370aa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.818645] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.818850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.818927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.819170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.819244] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.820426] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.820542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.820588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.820739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.820807] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4a90f8-0f8d-4a72-a1ab-081e60de92bf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.821799] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.821934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.822021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.822288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.822288] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.823270] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.823380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.823445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.823600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.823672] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.851729] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.851939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.852064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.852406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.877559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.877681] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb70f39c-753b-4f89-a31c-4120096fef6d is going to be deleted. [ 1066.936319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.936319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.936319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.936319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.936678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.936678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb70f39c-753b-4f89-a31c-4120096fef6d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.325917] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.325917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.325917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.326522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.326522] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.326522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.326522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.326719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.326915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.326915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.327123] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.335344] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.335344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.335344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.335587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.335587] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.335867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.335867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.335975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.336036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.336203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.336332] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.337252] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.337367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.337418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.337572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.337714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.337842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.337883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.337998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.338090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.338170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.338253] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.340449] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.340585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.340663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.341108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.341108] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.341108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.341108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.341766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.341766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.341766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.341766] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.351612] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.351765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.351829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.352101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.352347] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.352454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.352520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.352666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.352749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.352835] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.352921] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.359658] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.407448] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.407646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.407777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.407990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.409759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.409866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.411095] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.411200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.412024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.412151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.412905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.413062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.413942] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1067.413942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.414619] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.414737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.415467] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.415577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.416472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.416472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.417187] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.417299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.418137] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.418237] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.418873] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1067.419336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.419582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.420027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.420645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.420645] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.420645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.420645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.420880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.420960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.421081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.421200] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.422945] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1067.423254] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.423355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.424043] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1067.424975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.424975] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.425409] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1067.425577] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.425672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.441701] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1067.442277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.442444] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23475551-8968-4429-bd3c-c9fca786a07e is going to be deleted. [ 1067.443601] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.443823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.474239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.474442] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4bef8d2-2573-40a3-9fa1-478fba08e217 is going to be deleted. [ 1067.475747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.476026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.511500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.511743] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1845664f-8bfa-4c5b-b1d8-5f3082db2137 is going to be deleted. [ 1067.513038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.513352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.526123] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.526123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.540204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.540429] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be deleted. [ 1067.541393] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.541562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.543144] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.543283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.567246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.567485] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a824681a-154e-415a-8473-76ea98ebc45a is going to be deleted. [ 1067.568729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.568840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.596978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.597218] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4a90f8-0f8d-4a72-a1ab-081e60de92bf is going to be deleted. [ 1067.598410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.598410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.599980] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.600129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.621102] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.621300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.622144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.622298] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be deleted. [ 1067.623511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.623717] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.673449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.673695] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f7edcc5-73dd-4323-8612-25595c2370aa is going to be deleted. [ 1067.676110] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.676318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.676400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.676743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.676878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.677121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a824681a-154e-415a-8473-76ea98ebc45a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.677362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.677931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.704965] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.705200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.724942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.724942] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be deleted. [ 1067.726093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.726387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.739456] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.739639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.745208] env[65381]: INFO networking_nsxv3.common.synchronization [req-d810d930-d8f2-4090-b322-56c9208b4794 req-5b2dc76e-71e5-4da7-a0e0-a04ab53b82a0 tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1067.745829] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1067.746397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.746539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.746699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.747029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.747228] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.747355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.747739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.747739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.747853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.747915] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.802036] env[65381]: INFO networking_nsxv3.common.synchronization [req-a8eb7460-f15e-4569-8aea-471f4b69c16e req-cb70b341-8923-4776-b066-a6743911bcae tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1067.802036] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1067.802036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.802036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.802036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.802036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.802782] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.803070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.803581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.803914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.804127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.804365] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.807878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.808609] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca1b5748-90c1-473a-ab4f-767cc4ab05d7 is going to be deleted. [ 1067.810923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.811472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.832758] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.847197] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.847362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.847434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.847655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.847825] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.847926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.847991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.848158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.848247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.848338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.848526] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.848627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.848689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.848833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.848973] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.849076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.849160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.849312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.849387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.849472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.849974] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.850876] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.852385] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.852528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.863816] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.868273] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9694af19-2e42-4299-8799-3ccc40da653d: rpc.has_security_group_logging(os_id): False [ 1067.903533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.903689] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e917637-f523-43f9-9811-f2b68b364eb6 is going to be deleted. [ 1067.904702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.905043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.906562] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.906668] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.924940] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.924940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.930025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.930025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.930025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.930025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.930025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.930874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.930874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.930874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.930874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.930874] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.963336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.963482] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be deleted. [ 1067.965913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.966068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.970059] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.970244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.039479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.039479] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e525ee2-71eb-4b6c-8d4b-ec2247632bbc is going to be deleted. [ 1068.039879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.039987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.040040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.040173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23475551-8968-4429-bd3c-c9fca786a07e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.040336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.040520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.040645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.041086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4bef8d2-2573-40a3-9fa1-478fba08e217" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.041541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.041786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.041957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.042030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1845664f-8bfa-4c5b-b1d8-5f3082db2137" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.042234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.042492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.042547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.042646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.042783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.042929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.061413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.061588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.092941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.092941] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca937f1d-ad54-42e4-88d0-5a460de400c2 is going to be deleted. [ 1068.094020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.094356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.094356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.094510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4a90f8-0f8d-4a72-a1ab-081e60de92bf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.094628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.095602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.095602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.095839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.096451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.097217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.097394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.097595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f7edcc5-73dd-4323-8612-25595c2370aa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.097845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.098067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.098204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.098366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.098549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.098744] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.138950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.139334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.139483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.139557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.139721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.139803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.139910] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 1068.141656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.141656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.141656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.141656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca1b5748-90c1-473a-ab4f-767cc4ab05d7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.141656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.142023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.142096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.142219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e917637-f523-43f9-9811-f2b68b364eb6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.152099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.152491] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.152618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.152903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.153059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.153241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.191058] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.191345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.191461] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.191750] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.192536] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.192793] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.192962] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.193272] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.193472] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.193728] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.193875] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.194056] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.194218] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.194362] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.194494] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.194657] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.224031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.224031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.224031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.224031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.224031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.224031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e525ee2-71eb-4b6c-8d4b-ec2247632bbc" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.239032] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.239207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.239741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.239741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.239741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.239916] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca937f1d-ad54-42e4-88d0-5a460de400c2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.250416] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.250579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.250649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.250879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.250998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.251183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.251283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.251344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.251495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.251568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.251654] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be deleted. [ 1068.263736] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.264008] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.069 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.264219] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.264625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-684" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.265159] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-debce03f-545e-42d4-8538-04ce73e3c0b6 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.265426] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.265595] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.266045] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.266248] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('debce03f-545e-42d4-8538-04ce73e3c0b6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.313593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.313804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.313909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.314119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.328706] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.329133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.329133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.329232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.329275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.329355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.336363] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784f4514-1cec-43fd-97c8-9a7ad1576b94: rpc.has_security_group_logging(os_id): False [ 1068.352648] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0309f4f-d87e-4e36-bcfb-dc749a00a108: rpc.has_security_group_logging(os_id): False [ 1068.354052] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915a6b47-7bba-4851-9dc7-06e0692a5259: rpc.has_security_group_logging(os_id): False [ 1068.366082] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbd14683-7670-4a2a-a1cd-5d0d61d11e46: rpc.has_security_group_logging(os_id): False [ 1068.375374] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.375602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.391387] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.391614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.393101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.393101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.393595] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.393712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.394946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.395210] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.395360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.395434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.395673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.395859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.395931] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1068.397064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.397327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.397500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.398600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.398977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.418196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.418470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.421447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.421739] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.422045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.422341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.422418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.422489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.422715] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.422837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.422895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.423027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.423105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.423427] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.423427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.423427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.423602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.423639] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.423774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be updated. [ 1068.425705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.425891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.427786] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 1068.434975] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 1068.466923] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.467112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.467188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.467400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.467562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.475965] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.476199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.483738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.484101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.484275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.484408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.484833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.485223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.485385] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 is going to be updated. [ 1068.487642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.487642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.489304] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1068.513840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.514242] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.514319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.514380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.514732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.514950] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.515043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 is going to be updated. [ 1068.516363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.516608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.542940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.543137] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.543214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.543214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.543598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.543698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.543932] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.544153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.544153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.544320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.544400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.544598] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.544683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.544727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.544947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.545044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.545259] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1068.546581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.546749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.546836] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.547150] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.547289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.547357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.547505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.547582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.547670] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1068.581174] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.581389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.581389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.581592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.581918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.595351] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.595490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.595572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.595842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.596027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.600887] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.601113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.601222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.601396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.601552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.605160] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 1068.610285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: IN_PROGRESS for 2s [ 1068.614987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: IN_PROGRESS for 2s [ 1068.638397] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.638397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.638654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.638654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.638794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.683874] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.684164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.684164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.684395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.684461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.711910] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1068.720147] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1068.769623] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.769779] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.769862] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.770197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.770246] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.770590] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port debce03f-545e-42d4-8538-04ce73e3c0b6 not found, creating... [ 1068.770679] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.770806] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.770926] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.771176] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.771316] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.771604] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.771761] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.771878] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.772602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.772799] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.772957] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: debce03f-545e-42d4-8538-04ce73e3c0b6 is going to be created. [ 1068.829054] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.829290] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.829492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.829773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.830017] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.830278] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.453815] env[65381]: INFO networking_nsxv3.common.synchronization [req-d810d930-d8f2-4090-b322-56c9208b4794 req-0e3fd576-5f04-4286-be7d-784981fe3b62 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 1069.453815] env[65381]: INFO networking_nsxv3.common.synchronization [req-d810d930-d8f2-4090-b322-56c9208b4794 req-0e3fd576-5f04-4286-be7d-784981fe3b62 service nova] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1069.453815] env[65381]: INFO networking_nsxv3.common.synchronization [req-d810d930-d8f2-4090-b322-56c9208b4794 req-0e3fd576-5f04-4286-be7d-784981fe3b62 service nova] Enqueued Resource ID: debce03f-545e-42d4-8538-04ce73e3c0b6 with Priority: HIGHEST for action port [ 1069.454335] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_rules [ 1069.454447] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1069.454528] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: debce03f-545e-42d4-8538-04ce73e3c0b6 with Priority: HIGHEST for action port [ 1069.455177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.455177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.455462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.455505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.455549] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.461514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.461702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.461774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.461982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.462162] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.462912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.462912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.462912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.462912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.462912] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.463648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-debce03f-545e-42d4-8538-04ce73e3c0b6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.463648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.463800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.463905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.463954] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('debce03f-545e-42d4-8538-04ce73e3c0b6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.965502] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.966593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.966716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.967073] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port debce03f-545e-42d4-8538-04ce73e3c0b6 with status ACTIVE [ 1069.967243] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.967353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.967417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.967617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.967703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.967868] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.968116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.968116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.968272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.968272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.968439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.968529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.968592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.968722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.968796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.968873] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: debce03f-545e-42d4-8538-04ce73e3c0b6 is going to be updated. [ 1069.995922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.996094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.996094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.996388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.996648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.996967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-debce03f-545e-42d4-8538-04ce73e3c0b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.441137] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 1070.441373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.468086] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.505789] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1070.506111] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 deletion is rescheduled due to dependency. [ 1070.506168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.623277] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 1070.623277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.625706] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: SUCCESS [ 1070.625918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.628494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: SUCCESS [ 1070.628697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.727595] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1070.727838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.729622] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1070.729859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.974160] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.974332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.974400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.974624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.974712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.974826] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be created. [ 1070.998710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.998898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.998898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.999136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.999316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.008819] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: UNINITIALIZED for 2s [ 1073.021894] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1073.022313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.022530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.022771] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.022998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.023295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.023295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.023479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.023479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.023621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.023621] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.525939] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.526139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.526696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.527215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.527603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.527699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.527829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.528089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.528227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.528357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.528581] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.528730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.528828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.529078] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.529378] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.529441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.529523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.529742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.529870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.529996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.530136] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.032525] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9c03ef0-b5e2-4757-9488-6558cc6e9841: rpc.has_security_group_logging(os_id): False [ 1074.051775] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.051942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.052114] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.052269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.052370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.052589] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.052700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.052817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.053011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.053149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.053469] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.053725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.053725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.053964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.054121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.054429] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.054582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.054693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.054988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.055171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.055321] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be created. [ 1074.118592] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.118764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.118764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.119119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.119504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.134163] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 1074.298368] env[65381]: INFO networking_nsxv3.common.synchronization [req-feb7baed-b287-4278-93f0-a2e6d1cd7c43 req-15990a10-6ace-4b0e-a1d5-34b3905e8351 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1074.299146] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1074.299559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.299772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.299772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.300213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.300213] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.300333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.300333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.300531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.300615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.300717] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.803782] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.306940] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.809542] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.809739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.809776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.810035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.810145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.810234] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1075.844849] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.845141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.845195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.845407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.845599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.857208] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1076.150903] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1076.151162] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.115067] env[65381]: INFO networking_nsxv3.common.synchronization [req-ec79f712-e49b-4bca-afc0-5d3b2d39fbd0 req-1d448e89-175e-47a7-913d-2279997f0e2f tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1077.115364] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1077.115730] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.115730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.115730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.115970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.116186] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.116262] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.116329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.116540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.116595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.116681] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.446551] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.446833] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.447167] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.447283] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.447573] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.447781] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.447931] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.448204] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.448616] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.448616] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.448708] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.448798] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.448923] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.449048] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.449167] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.449302] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.470956] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.471138] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.471287] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.471515] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-483" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.471983] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-82e23860-cc3e-4518-834f-0eddbe0409c4 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.472150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.472271] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.472602] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.472765] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e23860-cc3e-4518-834f-0eddbe0409c4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.618745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.618919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.618971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.619231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.619368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.619609] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.619719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.619781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.619971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.620063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.620153] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be deleted. [ 1077.650681] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.650877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.650956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.651409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.651409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.651409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.869549] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1077.869816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.975725] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.976115] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.976312] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.976663] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.976874] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.977091] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 82e23860-cc3e-4518-834f-0eddbe0409c4 not found, creating... [ 1077.977496] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.977670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.977832] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.978184] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.978402] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.978739] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.978905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.979050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.979282] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.979416] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.979555] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 82e23860-cc3e-4518-834f-0eddbe0409c4 is going to be created. [ 1078.004728] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.005215] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.006175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.006175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.006175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.006434] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.711259] env[65381]: INFO networking_nsxv3.common.synchronization [req-ec79f712-e49b-4bca-afc0-5d3b2d39fbd0 req-73511642-7bd6-4ccd-88b6-d1dfe5d8c155 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 1078.711492] env[65381]: INFO networking_nsxv3.common.synchronization [req-ec79f712-e49b-4bca-afc0-5d3b2d39fbd0 req-73511642-7bd6-4ccd-88b6-d1dfe5d8c155 service nova] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1078.711492] env[65381]: INFO networking_nsxv3.common.synchronization [req-ec79f712-e49b-4bca-afc0-5d3b2d39fbd0 req-73511642-7bd6-4ccd-88b6-d1dfe5d8c155 service nova] Enqueued Resource ID: 82e23860-cc3e-4518-834f-0eddbe0409c4 with Priority: HIGHEST for action port [ 1078.713474] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_rules [ 1078.715112] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1078.715112] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e23860-cc3e-4518-834f-0eddbe0409c4 with Priority: HIGHEST for action port [ 1078.715112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.715112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.715112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.715112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.715112] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.717238] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.717238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.717238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.717465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.718686] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.718686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.718686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.718686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.718686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.718686] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.719846] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e23860-cc3e-4518-834f-0eddbe0409c4 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.719846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.720028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.720058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.720136] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e23860-cc3e-4518-834f-0eddbe0409c4',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.217792] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.218048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.222557] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82e23860-cc3e-4518-834f-0eddbe0409c4 with status ACTIVE [ 1079.223228] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.223228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.223228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.223447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.223640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.224234] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.224234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.224234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.224520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.224643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.225053] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.225172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.225239] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.225573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.225573] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.226067] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82e23860-cc3e-4518-834f-0eddbe0409c4 is going to be updated. [ 1079.227347] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.250718] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.250904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.250964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.251196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.251377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.251529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e23860-cc3e-4518-834f-0eddbe0409c4" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.730369] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.232743] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.232743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.232743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.232940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.233039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.233149] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be created. [ 1080.261814] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.262020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.262020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.262244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.262407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.275584] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: UNINITIALIZED for 2s [ 1080.616919] env[65381]: INFO networking_nsxv3.common.synchronization [req-2806eb46-2d6f-4d33-8da3-0451e2fd8ada req-b20e1242-6994-4ae7-a2d7-2efc209e7010 tempest-ServerDiskConfigTestJSON-1797521484 tempest-ServerDiskConfigTestJSON-1797521484-project-member] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1080.621151] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGHEST for action security_group_members [ 1080.621151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.621151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.621151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.621151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.621151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.621151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.621151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.621501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.621501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.621501] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.125380] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.125740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.125740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.125869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.125917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.126235] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.126387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.126387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.126489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.126530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.126640] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be updated. [ 1081.158920] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.159104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.160104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.160104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.160260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.171501] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: IN_PROGRESS for 2s [ 1081.215394] env[65381]: INFO networking_nsxv3.common.synchronization [req-17f6fcbb-19a5-49d3-8e1a-12975838a1af req-ced932f5-f682-483f-8c38-843001fdbea6 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1081.215394] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1081.215394] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.215394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.215394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.215394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.215896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.215896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.215896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.215896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.215896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.216140] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.652811] env[65381]: INFO networking_nsxv3.common.synchronization [req-da0c1dbc-1977-47f5-8bf9-0ef73af55c2d req-7b566935-a9e7-4dd2-beb0-552bcb445f30 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1081.653528] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1081.653877] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.654036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.654095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.654313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.654513] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.654635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.654732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.654903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.655057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.655120] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.718846] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.117204] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.117429] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.117600] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.117874] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.118638] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.119412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.119412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.119412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.119537] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.119792] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.119951] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.120065] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.120179] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.120294] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.120399] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.120532] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.145319] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.145794] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.145794] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.145873] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.146312] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-73aca3b3-2e02-42bc-b28a-6f1569bf555f taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.146538] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.146745] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.147163] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.147348] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73aca3b3-2e02-42bc-b28a-6f1569bf555f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.159470] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.159470] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.159470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.159470] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1082.188571] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.188790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.188790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.189013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.189244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.199469] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1082.220407] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.290173] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1082.290173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.290173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.290390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.291100] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.291100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.291100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.291314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.291314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.291422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.291515] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.650337] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.650579] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.650697] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.650980] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.651152] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.651336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 73aca3b3-2e02-42bc-b28a-6f1569bf555f not found, creating... [ 1082.651567] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.651727] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.651843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.652076] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.652216] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.652496] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.652650] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.652764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.652973] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.653261] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.653261] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 73aca3b3-2e02-42bc-b28a-6f1569bf555f is going to be created. [ 1082.675445] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.675756] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.675947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.676326] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.676616] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.676902] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.723625] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.723869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.723980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.724325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.724477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.724626] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1082.794077] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.794248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.794324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.794521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.794862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.796142] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.796300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.796383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.796622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.796848] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.796960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.797042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.797188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.797294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.797409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.797569] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.797669] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.797727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.797876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.798029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.798131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.798189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.798336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.798435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.798490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.798576] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.811743] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1083.183440] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 in Status: SUCCESS [ 1083.184733] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 deletion is rescheduled due to dependency. [ 1083.184733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.302170] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34a23f96-505a-4b63-87f3-5175bacc51ab: rpc.has_security_group_logging(os_id): False [ 1083.322512] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.322667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.322737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.322989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.323140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.323412] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.323546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.323633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.323872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.323987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.324278] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.324430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.324528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.324709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.324792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.324976] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.325265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.325319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.325475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.325554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.325648] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be created. [ 1083.408621] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.408840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.408840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.409087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.409259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.424463] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1083.847489] env[65381]: INFO networking_nsxv3.common.synchronization [req-da0c1dbc-1977-47f5-8bf9-0ef73af55c2d req-f4a259c2-0137-4ee6-bbea-d53527c38b83 service nova] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 1083.847489] env[65381]: INFO networking_nsxv3.common.synchronization [req-da0c1dbc-1977-47f5-8bf9-0ef73af55c2d req-f4a259c2-0137-4ee6-bbea-d53527c38b83 service nova] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1083.847489] env[65381]: INFO networking_nsxv3.common.synchronization [req-da0c1dbc-1977-47f5-8bf9-0ef73af55c2d req-f4a259c2-0137-4ee6-bbea-d53527c38b83 service nova] Enqueued Resource ID: 73aca3b3-2e02-42bc-b28a-6f1569bf555f with Priority: HIGHEST for action port [ 1083.847489] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 1083.847489] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1083.847489] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73aca3b3-2e02-42bc-b28a-6f1569bf555f with Priority: HIGHEST for action port [ 1083.847780] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.847780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.847780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.848033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.848104] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.849554] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.849554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.849754] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-73aca3b3-2e02-42bc-b28a-6f1569bf555f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.849817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.849864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.850052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.850134] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73aca3b3-2e02-42bc-b28a-6f1569bf555f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.211979] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1084.212401] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 deletion is rescheduled due to dependency. [ 1084.212401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.212466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.212671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.212856] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.213103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.213163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.213293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.213375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.213472] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.352021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.352240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.352521] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73aca3b3-2e02-42bc-b28a-6f1569bf555f with status ACTIVE [ 1084.352769] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.352940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.353104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.353417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.353527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.353763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.353963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.354091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.354291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.354378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.354596] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.354667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.354727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.354870] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.354973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.355085] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73aca3b3-2e02-42bc-b28a-6f1569bf555f is going to be updated. [ 1084.382369] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.382559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.382620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.382784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.382921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.383168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73aca3b3-2e02-42bc-b28a-6f1569bf555f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.715990] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.822694] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1084.822980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.218654] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.441777] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1085.442016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.721677] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.722245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.723040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.723383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.723760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.723927] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1085.762633] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.763116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.763116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.763299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.763516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.778494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1087.793955] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1087.794300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.794423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.794645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.794988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.794988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.795228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.795277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.795401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.795440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.795552] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.300384] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.804412] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915a6b47-7bba-4851-9dc7-06e0692a5259: rpc.has_security_group_logging(os_id): False [ 1088.823657] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.823799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.823866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.824110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.824196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.824436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.824533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.824594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.824740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.824811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.824893] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1088.848594] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1088.848711] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1088.895144] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.895312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.895371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.895586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.895727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.912017] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1090.928818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1090.929174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.213933] env[65381]: INFO networking_nsxv3.common.synchronization [req-d8446f14-0d72-427d-92ed-93d375976e33 req-baa0e18d-ad17-4ac9-b4b1-4f4f31746c8f tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1092.214488] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1092.214805] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.214914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.214986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.217385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.217593] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.217713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.217787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.217944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.218039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.218141] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.554870] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.555068] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.555283] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.555569] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.555827] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.556038] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.556168] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.556454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.556603] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.556814] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.556919] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.557035] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.557148] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.557253] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.557380] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.557535] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.578076] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.578239] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.578349] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.578520] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.578837] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-7342d84d-452a-4f26-b260-220cce3de145 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.579016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.579139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.579521] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.579669] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7342d84d-452a-4f26-b260-220cce3de145',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.720674] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.082859] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.083432] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.083639] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.083935] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.084102] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.084260] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 7342d84d-452a-4f26-b260-220cce3de145 not found, creating... [ 1093.084534] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.084727] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.084845] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.085124] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.085348] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.085680] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.086082] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.086082] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.086390] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.086747] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.086918] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 7342d84d-452a-4f26-b260-220cce3de145 is going to be created. [ 1093.107803] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.108023] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.109024] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.109024] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.109024] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.109024] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.223288] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.726173] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.726413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.726536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.726899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.727082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.727395] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1093.757921] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.758079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.758178] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.758459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.758666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.769549] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1093.825780] env[65381]: INFO networking_nsxv3.common.synchronization [req-d8446f14-0d72-427d-92ed-93d375976e33 req-fb8f5dfa-95ca-45c6-97da-c8b47cdcb172 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1093.825971] env[65381]: INFO networking_nsxv3.common.synchronization [req-d8446f14-0d72-427d-92ed-93d375976e33 req-fb8f5dfa-95ca-45c6-97da-c8b47cdcb172 service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1093.826130] env[65381]: INFO networking_nsxv3.common.synchronization [req-d8446f14-0d72-427d-92ed-93d375976e33 req-fb8f5dfa-95ca-45c6-97da-c8b47cdcb172 service nova] Enqueued Resource ID: 7342d84d-452a-4f26-b260-220cce3de145 with Priority: HIGHEST for action port [ 1093.826767] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1093.827099] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1093.827222] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7342d84d-452a-4f26-b260-220cce3de145 with Priority: HIGHEST for action port [ 1093.827580] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.827709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.827776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.828010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.828074] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.830743] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.830806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.830996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7342d84d-452a-4f26-b260-220cce3de145 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.831120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.831204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.831470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.831597] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7342d84d-452a-4f26-b260-220cce3de145',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.331193] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.331701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.333702] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7342d84d-452a-4f26-b260-220cce3de145 with status ACTIVE [ 1094.333891] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.334023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.334084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.334434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.334525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.334695] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.334810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.334854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.335023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.335101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.335330] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.335451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.335524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.335683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.335759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.335847] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7342d84d-452a-4f26-b260-220cce3de145 is going to be updated. [ 1094.356365] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.356511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.356663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.357065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.357065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.357251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7342d84d-452a-4f26-b260-220cce3de145" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.144697] env[65381]: INFO networking_nsxv3.common.synchronization [req-70b6790f-02fd-4653-9eed-e0416f6cc727 req-65e16eea-bdb5-460c-9898-c8486e43ac94 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_members [ 1095.145352] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGHEST for action security_group_members [ 1095.145686] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.145814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.145883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.146208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.146385] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.146496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.146558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.146750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.146815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.146898] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.648702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.649205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.649205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.649205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.649354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.649423] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.649532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.649646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.649766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.649865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.649958] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 is going to be updated. [ 1095.683956] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.684126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.684184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.684382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.684517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.695756] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: IN_PROGRESS for 2s [ 1095.794646] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1095.795884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.795884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.795884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.795884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.795884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.795884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.795884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.796254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.796254] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.298645] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.801043] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.304062] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.304062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.304062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.304062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.304062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.304062] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1097.338906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.339192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.339326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.339671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.339941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.352904] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1097.707023] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: IN_PROGRESS for 4s [ 1099.369912] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1099.370254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.370378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.370606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.370799] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.370919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.370984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.371173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.371258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.371346] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.371451] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.718336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 in Status: SUCCESS [ 1099.718615] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 deletion is rescheduled due to dependency. [ 1099.719035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.879689] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.879899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.879899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880209] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.880329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.880398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.880983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.881056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.881199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.881332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.881412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.881484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.881604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.881671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.881757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.881844] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.146575] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1100.146575] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1100.384964] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 1100.404152] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.404305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.404357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.404581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.404671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.404893] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.404995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.405120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.405329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.405329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.405582] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.405644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.405677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.405820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.405896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.406088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.406181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.406240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.406388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.406460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.406547] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1100.469012] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.469192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.469250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.469460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.469662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.491066] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1101.419696] env[65381]: INFO networking_nsxv3.common.synchronization [req-a34ab243-ac9d-45cb-a5df-8a634266fb23 req-b6d5abd4-3357-48d3-9e08-008a1494e064 tempest-ServerActionsV293TestJSON-106956911 tempest-ServerActionsV293TestJSON-106956911-project-member] Enqueued Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_members [ 1101.419919] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb494464-5516-45a4-9361-f2c93b57fef6 with Priority: HIGHEST for action security_group_members [ 1101.421016] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb494464-5516-45a4-9361-f2c93b57fef6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.421016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.421016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.421174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.421886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.421886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.421886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.422138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.422138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.422138] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb494464-5516-45a4-9361-f2c93b57fef6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.926589] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.926589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.926589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.926589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.951043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.951043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.951043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.951043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.951356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.951356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.951356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 is going to be updated. [ 1101.981048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.981254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.981254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.981461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.981615] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.991688] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb494464-5516-45a4-9361-f2c93b57fef6 in Status: IN_PROGRESS for 2s [ 1102.100776] env[65381]: INFO networking_nsxv3.common.synchronization [req-9224d35e-e72d-44d3-bad2-3ae63069ff69 req-db774864-dd6a-43e6-b8fd-1e3df175eb54 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1102.101446] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1102.101824] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.101967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.102081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.102302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.102681] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.102762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.102881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.103154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.103291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.103395] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.450883] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.451213] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.451213] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.451476] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.451724] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.451880] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.451992] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.452230] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.452370] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.452583] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.452694] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.452803] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.452912] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.453142] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.453142] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.453328] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.474970] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.475159] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.475336] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.475516] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.475831] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-3956782f-23c8-4d34-bd69-d64bbeba4f32 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.476015] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.476146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.476477] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.476612] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3956782f-23c8-4d34-bd69-d64bbeba4f32',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.506998] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1102.507226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.605205] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.605360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.605774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.605774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.605774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.605926] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.606032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.606112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.606272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.607258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.607258] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be deleted. [ 1102.636119] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.636334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.636334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.636539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.636633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.636754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.978808] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.978808] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.978808] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.979122] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.979299] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.979439] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 3956782f-23c8-4d34-bd69-d64bbeba4f32 not found, creating... [ 1102.979726] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.979860] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.980029] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.980234] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.980936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.981257] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.981421] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.981567] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.981815] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.981947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.982120] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 3956782f-23c8-4d34-bd69-d64bbeba4f32 is going to be created. [ 1103.003392] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.003694] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.003863] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.004158] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.004389] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.004621] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.733552] env[65381]: INFO networking_nsxv3.common.synchronization [req-9224d35e-e72d-44d3-bad2-3ae63069ff69 req-f2fc66d9-8177-47bd-a377-dbb09557e66b service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1103.733792] env[65381]: INFO networking_nsxv3.common.synchronization [req-9224d35e-e72d-44d3-bad2-3ae63069ff69 req-f2fc66d9-8177-47bd-a377-dbb09557e66b service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1103.734016] env[65381]: INFO networking_nsxv3.common.synchronization [req-9224d35e-e72d-44d3-bad2-3ae63069ff69 req-f2fc66d9-8177-47bd-a377-dbb09557e66b service nova] Enqueued Resource ID: 3956782f-23c8-4d34-bd69-d64bbeba4f32 with Priority: HIGHEST for action port [ 1103.734544] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1103.734959] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1103.734959] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3956782f-23c8-4d34-bd69-d64bbeba4f32 with Priority: HIGHEST for action port [ 1103.735050] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.735160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.735232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.735483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.735566] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.736745] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.736853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.737583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.737583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.737711] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.737822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.739496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.739496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.739496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.739496] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.739496] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-3956782f-23c8-4d34-bd69-d64bbeba4f32 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.739496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.739496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.739496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.739496] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3956782f-23c8-4d34-bd69-d64bbeba4f32',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.004996] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb494464-5516-45a4-9361-f2c93b57fef6 in Status: SUCCESS [ 1104.004996] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb494464-5516-45a4-9361-f2c93b57fef6 deletion is rescheduled due to dependency. [ 1104.005611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb494464-5516-45a4-9361-f2c93b57fef6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.241160] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.242226] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.242341] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.242565] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3956782f-23c8-4d34-bd69-d64bbeba4f32 with status ACTIVE [ 1104.242672] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.242776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.242845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.243062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.243150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.243502] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.243659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.243763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.243947] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.244777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.244777] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.244866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.244894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.245204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.245298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.245531] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3956782f-23c8-4d34-bd69-d64bbeba4f32 is going to be updated. [ 1104.267515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.267707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.267770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.268150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.268150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.268271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3956782f-23c8-4d34-bd69-d64bbeba4f32" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.747892] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.249990] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.250251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.250293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.250580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.250625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.250730] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be created. [ 1105.274896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.275093] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.275146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.275365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.275551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.286064] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: UNINITIALIZED for 2s [ 1105.359962] env[65381]: INFO networking_nsxv3.common.synchronization [req-c8f0e3b7-80fb-4e49-a718-595ef9565148 req-5bc8e164-6ffa-4375-94d8-079ea302462a tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1105.361104] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1105.361382] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.361508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.361580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.361787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.361933] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.362042] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.362106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.362257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.362392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.362434] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.865100] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.900031] env[65381]: INFO networking_nsxv3.common.synchronization [req-c4a9e221-ae5b-4503-b305-e9322b2c5144 req-b0522720-c7d4-47e0-ab8b-41d836b6ddbd tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 1105.900554] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 1105.900888] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.901021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.901086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.901282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.901467] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.901582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.901650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.901805] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.901890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.901982] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.262204] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.262444] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.262936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.262936] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.263263] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.263430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.263547] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.263771] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.263911] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.264312] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.264312] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.264423] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.264474] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.264615] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.264774] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.264931] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.284756] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.285037] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.285137] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.285256] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.285667] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-6cdb7a5a-8d07-4788-842a-57408dedfbe3 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.285847] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.285979] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.286356] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.286535] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cdb7a5a-8d07-4788-842a-57408dedfbe3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.310830] env[65381]: INFO networking_nsxv3.common.synchronization [req-ee210e9f-b1d7-46c3-8b9e-67f61632b382 req-19989308-51a3-4fb8-a892-c3471a36ce7e tempest-AttachVolumeTestJSON-1512309110 tempest-AttachVolumeTestJSON-1512309110-project-member] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_members [ 1106.311328] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGHEST for action security_group_members [ 1106.311639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.311766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.311833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.312040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.312194] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.312296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.312359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.312516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.312596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.312689] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.367992] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.403995] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.404192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.404236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.404442] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.404531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.404722] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.404818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.404879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.405028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.405256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.405256] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be deleted. [ 1106.440393] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.440610] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.440690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.440904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.440992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.441106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.790363] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.791983] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.792174] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.792506] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.792676] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.792887] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 6cdb7a5a-8d07-4788-842a-57408dedfbe3 not found, creating... [ 1106.793297] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.793532] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.793680] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.793941] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.795782] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.796495] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.796495] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.796495] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.796689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.796825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.796977] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 is going to be created. [ 1106.818128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.818353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.818441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.818715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.827470] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.827743] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.827881] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.828193] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.828430] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.828686] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.852087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.852087] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.852221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.852406] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.852448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.852503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.852593] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d is going to be updated. [ 1106.870233] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.870614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.870614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.870683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.871049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.871049] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1106.901494] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.901801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.901891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.902226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.903218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.905083] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.905164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.905198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.905452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.905603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.916955] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d13ab4e4-01d1-4513-ab86-141d5851283d in Status: IN_PROGRESS for 2s [ 1106.917714] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1107.296670] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1107.296901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.297098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.297327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.297520] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.297643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.297715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.297865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.297946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.298044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.298138] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.800588] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.801112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.801112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.801112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.801267] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.801327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.801360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.801521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.801602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.801690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.801833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.801925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.801985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.802142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.802276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.802367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.802427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.802564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.802634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.802713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.802799] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.992521] env[65381]: INFO networking_nsxv3.common.synchronization [req-c4a9e221-ae5b-4503-b305-e9322b2c5144 req-d394ef02-9776-45a6-b79a-447ff2caa8c7 service nova] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_rules [ 1107.992806] env[65381]: INFO networking_nsxv3.common.synchronization [req-c4a9e221-ae5b-4503-b305-e9322b2c5144 req-d394ef02-9776-45a6-b79a-447ff2caa8c7 service nova] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 1107.992844] env[65381]: INFO networking_nsxv3.common.synchronization [req-c4a9e221-ae5b-4503-b305-e9322b2c5144 req-d394ef02-9776-45a6-b79a-447ff2caa8c7 service nova] Enqueued Resource ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 with Priority: HIGHEST for action port [ 1107.993510] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_rules [ 1107.993767] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 1107.993767] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 with Priority: HIGHEST for action port [ 1107.993993] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.994115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.994218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.994391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.994509] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.995496] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.995496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.995589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.995776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.996171] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.996171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.996171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.996171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.996371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.996371] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.997302] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cdb7a5a-8d07-4788-842a-57408dedfbe3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.997302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.997302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.997524] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.997524] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cdb7a5a-8d07-4788-842a-57408dedfbe3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.305614] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e855adc-3508-49b6-b8b1-1007e65b954b: rpc.has_security_group_logging(os_id): False [ 1108.324714] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.324924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.324924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.325155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.325244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.325533] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.325672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.325722] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.325847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.325920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.326127] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.326220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.326279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.326458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.326554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.326739] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.326835] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.326896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.327048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.327124] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.327206] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be created. [ 1108.382391] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.382599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.382599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.382849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.383038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.401709] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1108.498880] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.500223] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.500367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.500834] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cdb7a5a-8d07-4788-842a-57408dedfbe3 with status ACTIVE [ 1108.501489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.501489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.501489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.501740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.501740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.502269] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.502269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.502269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.502441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.502557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.502831] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.502992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.503110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.503315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.503432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.503550] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 is going to be updated. [ 1108.531293] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.531503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.531634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.531740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.531884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.532059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.928512] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d13ab4e4-01d1-4513-ab86-141d5851283d in Status: SUCCESS [ 1108.928751] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d deletion is rescheduled due to dependency. [ 1108.928921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.929703] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1108.929911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.001452] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.078884] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6e492db7-d9b5-4305-a733-07e9898a00cf tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1109.079355] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1109.079659] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.079781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.079849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.080076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.080230] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.080331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.080395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.080693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.080693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.080781] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.504297] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.504501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.504596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.504905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.505062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.505214] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be created. [ 1109.529975] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.530153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.530224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.530437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.530690] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.540568] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: UNINITIALIZED for 2s [ 1109.584092] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.086556] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.419799] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1110.419980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.589399] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.589592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.589664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.589933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.590044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.590147] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1110.620362] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.620568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.620617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.620849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.621036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.630822] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1111.020734] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.020734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.020734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.020734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.020734] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.021067] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.021067] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.021343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.021343] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.021537] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.021648] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.021752] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.021854] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.021958] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.022072] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.022203] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.042197] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.042434] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.042568] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.042792] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.043128] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-ab187172-0668-4c43-ab50-6d54f8d53232 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.043303] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.043463] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.043832] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.044052] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab187172-0668-4c43-ab50-6d54f8d53232',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.112165] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.112455] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.112455] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.112693] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.112965] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.113141] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.113256] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.113475] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.113613] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.113815] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.113928] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.114055] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.114161] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.114271] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.114377] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.114507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.142132] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.142442] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.142665] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.142946] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.143164] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.143342] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.143475] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.143836] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.144015] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea76ab6d-8998-4872-b9c6-b9124ca5c70c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.546514] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.546773] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.546903] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.547190] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.547335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.547617] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.547776] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.547894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.548128] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.548262] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.548535] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.548689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.548804] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.549012] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.549150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.549288] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: ab187172-0668-4c43-ab50-6d54f8d53232 is going to be updated. [ 1111.551221] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: SUCCESS [ 1111.551410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.551557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.551715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.551867] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.551967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.552045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.552189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.552267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.552352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.552442] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.570872] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.571106] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.571230] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.571503] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.571701] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.571934] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.646695] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.646943] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.647062] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.647446] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.647559] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.647677] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port ea76ab6d-8998-4872-b9c6-b9124ca5c70c not found, creating... [ 1111.647934] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.648118] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.648234] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.648457] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.648622] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.648869] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.649030] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.649492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.649492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.649492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.649667] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: ea76ab6d-8998-4872-b9c6-b9124ca5c70c is going to be created. [ 1111.693659] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.693843] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.693969] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.694359] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.694611] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.694849] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.054703] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.054876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.054951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.055381] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.055514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.055583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.055831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.055922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.056171] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.056171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.056294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.056375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.056559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.056627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.056661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.056791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.056867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.056965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.057066] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.283310] env[65381]: INFO networking_nsxv3.common.synchronization [req-91d99d82-983b-4cde-b6fd-4b29eb472a56 req-f01e1537-64f7-4850-96e0-8e83b36cebcb service nova] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1112.283310] env[65381]: INFO networking_nsxv3.common.synchronization [req-91d99d82-983b-4cde-b6fd-4b29eb472a56 req-f01e1537-64f7-4850-96e0-8e83b36cebcb service nova] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1112.283310] env[65381]: INFO networking_nsxv3.common.synchronization [req-91d99d82-983b-4cde-b6fd-4b29eb472a56 req-f01e1537-64f7-4850-96e0-8e83b36cebcb service nova] Enqueued Resource ID: ab187172-0668-4c43-ab50-6d54f8d53232 with Priority: HIGHEST for action port [ 1112.283640] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_rules [ 1112.283670] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1112.283772] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab187172-0668-4c43-ab50-6d54f8d53232 with Priority: HIGHEST for action port [ 1112.284603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.284838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.284951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.285226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.285368] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.286889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.287075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.287249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.289088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.289088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.289088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.289088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.289088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.289088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.289088] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.289088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab187172-0668-4c43-ab50-6d54f8d53232 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.289088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.289772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.289772] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.289772] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab187172-0668-4c43-ab50-6d54f8d53232',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.377933] env[65381]: INFO networking_nsxv3.common.synchronization [req-a8edf3b3-0415-4bae-833e-1582094ec9a6 req-312db916-fda2-4e40-b78a-0a4b7b518b1d service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1112.378168] env[65381]: INFO networking_nsxv3.common.synchronization [req-a8edf3b3-0415-4bae-833e-1582094ec9a6 req-312db916-fda2-4e40-b78a-0a4b7b518b1d service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1112.378274] env[65381]: INFO networking_nsxv3.common.synchronization [req-a8edf3b3-0415-4bae-833e-1582094ec9a6 req-312db916-fda2-4e40-b78a-0a4b7b518b1d service nova] Enqueued Resource ID: ea76ab6d-8998-4872-b9c6-b9124ca5c70c with Priority: HIGHEST for action port [ 1112.378797] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1112.378931] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1112.379209] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea76ab6d-8998-4872-b9c6-b9124ca5c70c with Priority: HIGHEST for action port [ 1112.379789] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.379973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.380102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.380342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.380618] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.381758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.381909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.382173] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.382330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.382433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.382664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.382785] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea76ab6d-8998-4872-b9c6-b9124ca5c70c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.560135] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ea7ac34-a800-4898-bb50-0dd416be04d0: rpc.has_security_group_logging(os_id): False [ 1112.578903] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.579080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.579132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.579348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.579461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.579706] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.579793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.579859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.580061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.580160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.580356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.580454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.580514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.580656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.580752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.580911] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.580996] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.581073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.581215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.581289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.581375] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be created. [ 1112.635196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.635378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.635419] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.635693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.635881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.641098] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1112.641287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.641998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.642120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.642296] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.642408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.642474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.642623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.642704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.642800] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.645788] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: IN_PROGRESS for 2s [ 1112.792559] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.792760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.792918] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.794069] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab187172-0668-4c43-ab50-6d54f8d53232 with status ACTIVE [ 1112.794069] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.794317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.794317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.794459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.794533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.794712] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.794816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.794873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.795014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.795084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.795275] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.795384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.795449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.795647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.795720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.795792] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab187172-0668-4c43-ab50-6d54f8d53232 is going to be updated. [ 1112.818656] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.818853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.818896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.819109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.819246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.819420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab187172-0668-4c43-ab50-6d54f8d53232" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.885303] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.885472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.887851] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea76ab6d-8998-4872-b9c6-b9124ca5c70c with status ACTIVE [ 1112.888060] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.888234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.888350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.888641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.888775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.889014] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.889183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.889267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.889435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.889521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.889800] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.889920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.889985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.890156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.890235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.890470] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea76ab6d-8998-4872-b9c6-b9124ca5c70c is going to be updated. [ 1112.923024] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.923024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.923024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.923294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.923546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.923794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea76ab6d-8998-4872-b9c6-b9124ca5c70c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.145470] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.297782] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.648148] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.799970] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.800153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.800209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.800439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.800533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.800680] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 is going to be updated. [ 1113.850068] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.850068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.850347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.850347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.850468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.863774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: IN_PROGRESS for 2s [ 1114.150535] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.150705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.150754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.151081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.151181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.151326] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1114.179295] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.179463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.179550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.179704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.179842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.188495] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1114.660271] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: SUCCESS [ 1114.660634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.874525] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: SUCCESS [ 1115.875039] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.875427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.876882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.877121] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.877245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.877303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.877544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.877544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.877652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.877793] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.199116] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1116.199116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.199306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.199431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.199606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.199752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.199866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.200165] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.200264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.200357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.200690] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.380320] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.703413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.703861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.704340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.705161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.705840] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.706348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.706557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.706859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.706986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.707144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.707413] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.707563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.707660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.707938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.708164] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.708307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.708400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.708647] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.708766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.708891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.709035] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.883818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5ab19d-0519-49e0-95a2-457ebf3b46a0: rpc.has_security_group_logging(os_id): False [ 1116.903296] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.903514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.903598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.903840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.928330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.928703] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.928840] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.928912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.929207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.929392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.929479] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 is going to be updated. [ 1116.995854] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.996580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.996700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.996951] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.997138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.014249] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: IN_PROGRESS for 2s [ 1117.213446] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e855adc-3508-49b6-b8b1-1007e65b954b: rpc.has_security_group_logging(os_id): False [ 1117.233769] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.233960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.233960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.234168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.234281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.234623] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.235445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.235445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.235445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.235445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.235445] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.235670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.235670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.235809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.236519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.236519] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.236519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.236519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.236519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.236519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.236750] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1117.312471] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.312637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.312688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.312886] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.313043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.340079] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1117.380584] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1117.380730] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1117.695319] env[65381]: INFO networking_nsxv3.common.synchronization [req-62b71ff1-201b-4ffd-95c2-bed332729d20 req-15450d37-1717-4ca8-94c9-4edba26ee67a tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 1117.696207] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGHEST for action security_group_members [ 1117.698031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.698196] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.698430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.698539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.698766] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.698908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.698993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.699189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.699284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.699380] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.740775] env[65381]: INFO networking_nsxv3.common.synchronization [req-62b71ff1-201b-4ffd-95c2-bed332729d20 req-15450d37-1717-4ca8-94c9-4edba26ee67a tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 with Priority: HIGHEST for action port [ 1117.741305] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 with Priority: HIGHEST for action port [ 1117.741842] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cdb7a5a-8d07-4788-842a-57408dedfbe3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.742531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.742625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.742833] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.742910] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cdb7a5a-8d07-4788-842a-57408dedfbe3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.201998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.202328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.202446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.202596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.202759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.203075] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.203075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.203075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.203268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.203268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.203473] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be updated. [ 1118.246176] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6cdb7a5a-8d07-4788-842a-57408dedfbe3 with status ACTIVE [ 1118.246370] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.246593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.246701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.246934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.247040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.247259] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.247377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.247438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.247588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.247664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.247910] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.248015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.248078] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.248222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.248297] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.248383] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6cdb7a5a-8d07-4788-842a-57408dedfbe3 is going to be updated. [ 1118.269085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.269241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.269313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.269526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.270810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.279621] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.279804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.279847] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.280038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.280171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.280334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cdb7a5a-8d07-4788-842a-57408dedfbe3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.281102] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: IN_PROGRESS for 2s [ 1119.031053] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: SUCCESS [ 1119.031296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.359949] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1119.360233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.291064] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 in Status: SUCCESS [ 1120.291251] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 deletion is rescheduled due to dependency. [ 1120.291366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.743134] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.743134] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1122.910185] env[65381]: INFO networking_nsxv3.common.synchronization [req-9c05a398-c963-4052-8a7d-bb270d03d944 req-38bfeeb0-86ed-4a68-bbbd-10579b2d4aa7 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1122.910937] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1122.911292] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.911418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.911515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.911728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.911892] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.911991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.912075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.912232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.912324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.912418] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.247691] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-646 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.247979] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.248168] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.248536] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.248910] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.249169] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.249333] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.249624] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.249825] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.250122] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.250286] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.250466] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.250628] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.250787] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.250942] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.251142] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.276345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.276515] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.276804] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.276925] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-646" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.277274] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.277454] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.277575] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.278192] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.278339] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('533bbb0b-6df6-46d2-8c7b-04e686a2ce05',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.415263] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.781398] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.781790] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.781790] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.782094] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.782394] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.782622] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 533bbb0b-6df6-46d2-8c7b-04e686a2ce05 not found, creating... [ 1123.783063] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.783267] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.783381] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.783667] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.783807] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.784198] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.784386] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.784555] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.784785] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.784920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.785074] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 533bbb0b-6df6-46d2-8c7b-04e686a2ce05 is going to be created. [ 1123.814899] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.815271] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.815485] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.815959] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.816311] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.816584] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.917862] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.420334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.420488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.420560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.420829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.420936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.421055] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1124.452313] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.452527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.452527] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.452747] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.452893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.462516] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1124.509463] env[65381]: INFO networking_nsxv3.common.synchronization [req-9c05a398-c963-4052-8a7d-bb270d03d944 req-ddc8e686-c60a-409e-865c-2e8fb97a3dee service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1124.509463] env[65381]: INFO networking_nsxv3.common.synchronization [req-9c05a398-c963-4052-8a7d-bb270d03d944 req-ddc8e686-c60a-409e-865c-2e8fb97a3dee service nova] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1124.509563] env[65381]: INFO networking_nsxv3.common.synchronization [req-9c05a398-c963-4052-8a7d-bb270d03d944 req-ddc8e686-c60a-409e-865c-2e8fb97a3dee service nova] Enqueued Resource ID: 533bbb0b-6df6-46d2-8c7b-04e686a2ce05 with Priority: HIGHEST for action port [ 1124.510685] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_rules [ 1124.510685] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1124.510685] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 533bbb0b-6df6-46d2-8c7b-04e686a2ce05 with Priority: HIGHEST for action port [ 1124.510953] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.511826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.511826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.511826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.511826] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.513305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.513390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.513659] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.513820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.515839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.515839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.515839] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('533bbb0b-6df6-46d2-8c7b-04e686a2ce05',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.517850] env[65381]: INFO networking_nsxv3.common.synchronization [req-db43a49b-d7e0-4e7e-9532-eecb8b0f7330 req-c6a33b97-f384-42c7-8aa9-4b0cbf0664ab tempest-DeleteServersTestJSON-1709167294 tempest-DeleteServersTestJSON-1709167294-project-member] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1124.518572] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGHEST for action security_group_members [ 1124.519118] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.519118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.519867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.519867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.519985] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.520242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.520242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.521678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.521678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.521678] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.016742] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.017119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.019339] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 533bbb0b-6df6-46d2-8c7b-04e686a2ce05 with status ACTIVE [ 1125.019546] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.020582] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.020582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.020920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.020920] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.020920] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.021041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.021175] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.021215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.021276] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 533bbb0b-6df6-46d2-8c7b-04e686a2ce05 is going to be updated. [ 1125.022514] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.022653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.022653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.022781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.022930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.023038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.023120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.023215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.023315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.023387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.023470] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be updated. [ 1125.057059] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.057059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.057059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.057059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.057059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.057059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-533bbb0b-6df6-46d2-8c7b-04e686a2ce05" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.058843] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.058966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.059047] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.059232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.059356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.068438] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: IN_PROGRESS for 2s [ 1126.136467] env[65381]: INFO networking_nsxv3.common.synchronization [req-8b7032f8-323b-48ae-814f-ee8af654d20f req-0d155d92-bdc7-4090-9821-35ad22367424 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1126.137054] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1126.137316] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.137439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.137508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.137701] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.137852] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.137978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.138169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.138358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.138452] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.138547] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.473849] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1126.474096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.474275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.474504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.474693] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.474811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.474876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.475040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.475121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.475217] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.641510] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.978096] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.079221] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34a23f96-505a-4b63-87f3-5175bacc51ab in Status: SUCCESS [ 1127.079404] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab deletion is rescheduled due to dependency. [ 1127.079544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.091453] env[65381]: INFO networking_nsxv3.common.synchronization [None req-ec54a145-00bc-4a64-aa74-7bfdf97cd4cf tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1127.092187] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1127.092342] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.092447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.143973] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.481516] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.652907] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.652907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.652907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1127.685618] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.685618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.685618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.685618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.685618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.694565] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1127.984404] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.984769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.984769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.985088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.985261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.985411] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1128.019332] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.019484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.019529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.020733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.020733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.029350] env[65381]: INFO networking_nsxv3.common.synchronization [req-5724ac7b-07e7-4535-a2e8-0849d457e749 req-fb9e90c3-c33b-4d66-aec9-ec5856dad67e tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_members [ 1128.029959] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGHEST for action security_group_members [ 1128.030489] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.030599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.030599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.031545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.031545] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.031688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.032083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.032083] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.032187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.032283] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.034244] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1128.535758] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.536159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.536159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.536252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.536826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.536826] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.536826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.536826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.537064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.537064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.537118] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 is going to be updated. [ 1128.574305] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.574466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.574533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.574759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.574976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.585487] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: IN_PROGRESS for 2s [ 1129.709664] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.709664] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.709664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.709664] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.871646] env[65381]: INFO networking_nsxv3.common.synchronization [req-d4142c4d-c45f-4c90-95c8-f99f05b988c9 req-228ec3c4-d4aa-4cd5-82a0-f4463164ca43 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_members [ 1129.873313] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGHEST for action security_group_members [ 1129.873392] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.873477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.873508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.873735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.873886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.873980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.874056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.874202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.874608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.874608] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.045037] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1130.045272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.045874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.046125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.046324] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.046444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.046509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.046705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.046822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.046822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.046917] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.212071] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.212250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.212293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.212591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.212591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.212810] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.212882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.212930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.213089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.213163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.213247] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1130.243970] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.243970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.243970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.243970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.243970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.252620] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1130.377306] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.377462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.377535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.377749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.399154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.399411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.399533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.399600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.399800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.399883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.399973] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 is going to be updated. [ 1130.437724] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.437949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.438087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.438375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.438619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.477911] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 in Status: IN_PROGRESS for 2s [ 1130.549905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.549905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.549905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.549905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.549905] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.549905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.549905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.550291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.550291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.550291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.550377] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.550417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.550448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.550597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.550730] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.550819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.550877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.551017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.551145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.551186] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.551245] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.596859] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 in Status: SUCCESS [ 1130.597081] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 deletion is rescheduled due to dependency. [ 1130.597214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.053116] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61: rpc.has_security_group_logging(os_id): False [ 1131.073220] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.073220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.073355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.073511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.073627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.073836] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.073940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.074011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.074168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.074245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.074417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.074529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.074595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.074737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.074811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.075010] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.075120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.075181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.075318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.075402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.075522] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1131.160902] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.161111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.161177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.161409] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.161567] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.181228] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1132.262904] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1132.262904] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b deletion is rescheduled due to dependency. [ 1132.262904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.489838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 in Status: SUCCESS [ 1132.489838] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 deletion is rescheduled due to dependency. [ 1132.490048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.202039] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1133.202533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.874039] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1134.874337] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1135.871195] env[65381]: INFO networking_nsxv3.common.synchronization [None req-dc3a45f6-67ed-4764-a89d-b4e40a3daa06 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1135.871718] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1135.872029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.872157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.872252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.872472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.872552] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.961217] env[65381]: INFO networking_nsxv3.common.synchronization [None req-992fc3d5-1a0b-4c2d-bea6-1cc239c0fce8 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1135.961837] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1135.962193] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.962344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.399236] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.399236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.399236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.399603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.399878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.400357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 already deleted. [ 1136.400549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.401850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.401850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.401850] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.928319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.928471] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.928547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.928795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.928866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.928990] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 already deleted. [ 1136.929057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.110663] env[65381]: INFO networking_nsxv3.common.synchronization [req-11d0d170-a31e-4630-ac90-ab44b1d86ec3 req-b52a5ef2-5bee-4ac5-ba53-08345db2c92a tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1137.111390] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1137.112053] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.112053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.112053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.112249] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.112249] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.112429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.112429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.112542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.112728] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.112728] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.256437] env[65381]: INFO networking_nsxv3.common.synchronization [None req-585ac527-3fa3-4bcc-aa8c-824293b515d6 None None] Enqueued Resource ID: c04d753a-34b1-439e-94a7-ca099ee4baf7 with Priority: HIGHEST for action port [ 1137.256989] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d753a-34b1-439e-94a7-ca099ee4baf7 with Priority: HIGHEST for action port [ 1137.257584] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c04d753a-34b1-439e-94a7-ca099ee4baf7 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.257584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c04d753a-34b1-439e-94a7-ca099ee4baf7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.257584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c04d753a-34b1-439e-94a7-ca099ee4baf7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.257905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c04d753a-34b1-439e-94a7-ca099ee4baf7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.257905] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c04d753a-34b1-439e-94a7-ca099ee4baf7',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.615866] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.760424] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c04d753a-34b1-439e-94a7-ca099ee4baf7 [ 1137.760735] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.760910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.761190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.761420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.761538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.761683] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c04d753a-34b1-439e-94a7-ca099ee4baf7 already deleted. [ 1137.761783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c04d753a-34b1-439e-94a7-ca099ee4baf7" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.119374] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.624903] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.625115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.625216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.625400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.625487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.625592] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1138.655510] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.655658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.655742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.655981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.656150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.665683] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1139.539488] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e4c85036-c355-462c-9650-1a3c11ef4295 None None] Enqueued Resource ID: 8caf5c37-0b97-4db7-a5f5-b87d36740dd0 with Priority: HIGHEST for action port [ 1139.540110] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8caf5c37-0b97-4db7-a5f5-b87d36740dd0 with Priority: HIGHEST for action port [ 1139.540436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8caf5c37-0b97-4db7-a5f5-b87d36740dd0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.540597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8caf5c37-0b97-4db7-a5f5-b87d36740dd0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.540662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8caf5c37-0b97-4db7-a5f5-b87d36740dd0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.540884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8caf5c37-0b97-4db7-a5f5-b87d36740dd0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.540955] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8caf5c37-0b97-4db7-a5f5-b87d36740dd0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.043402] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8caf5c37-0b97-4db7-a5f5-b87d36740dd0 [ 1140.043641] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.043769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.043857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.044159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.044252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.044352] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8caf5c37-0b97-4db7-a5f5-b87d36740dd0 already deleted. [ 1140.044430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8caf5c37-0b97-4db7-a5f5-b87d36740dd0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.290989] env[65381]: INFO networking_nsxv3.common.synchronization [req-a8eeb88d-1f0a-454e-b09f-85ba30d15a66 req-d31e18ce-22c8-4d37-a30b-e217bcb383c8 tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 1140.291877] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 1140.292401] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.292583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.292683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.293224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.293420] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.293533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.293607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.293868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.293966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.294104] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.677699] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1140.678106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.797561] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.299806] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.802910] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.802910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.803398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.803398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.803398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.803490] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be updated. [ 1141.831873] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.832077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.832122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.832357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.832502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.842866] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 1143.511180] env[65381]: INFO networking_nsxv3.common.synchronization [req-1828f3ba-38c8-4bc3-8887-357f5dba49f2 req-66ff4205-633f-47a7-b267-c43ad01ccfb4 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1143.511899] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1143.512521] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.512692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.512841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.513121] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.513290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.513398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.513461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.513619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.513705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.513823] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.828047] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.828335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.828533] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.828857] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.829348] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.829525] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.829645] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.829870] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.830024] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.830242] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.830355] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.830460] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.830566] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.830672] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.830776] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.830906] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.858661] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 1143.858987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.864572] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.864759] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.864881] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.865096] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.865437] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-07b36acb-b1d1-438f-b2b1-43ee1597f479 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.865613] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.865734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.866150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.866257] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07b36acb-b1d1-438f-b2b1-43ee1597f479',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.016078] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.016277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.016277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.016553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.016644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.016899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.017064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.017064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.017208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.017208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.017396] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 already deleted. [ 1144.017450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.368753] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.368988] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.369150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.369435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.369585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.369740] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 07b36acb-b1d1-438f-b2b1-43ee1597f479 not found, creating... [ 1144.370020] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.370192] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.370307] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.370528] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.370663] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.370945] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.371116] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.371254] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.371476] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.371609] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.371747] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 07b36acb-b1d1-438f-b2b1-43ee1597f479 is going to be created. [ 1144.392563] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.392765] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.392890] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.393178] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.393404] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.393619] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.079772] env[65381]: INFO networking_nsxv3.common.synchronization [req-1828f3ba-38c8-4bc3-8887-357f5dba49f2 req-2b1a8a4a-d20c-4a7d-a130-c461cb833127 service nova] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1145.080064] env[65381]: INFO networking_nsxv3.common.synchronization [req-1828f3ba-38c8-4bc3-8887-357f5dba49f2 req-2b1a8a4a-d20c-4a7d-a130-c461cb833127 service nova] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1145.080212] env[65381]: INFO networking_nsxv3.common.synchronization [req-1828f3ba-38c8-4bc3-8887-357f5dba49f2 req-2b1a8a4a-d20c-4a7d-a130-c461cb833127 service nova] Enqueued Resource ID: 07b36acb-b1d1-438f-b2b1-43ee1597f479 with Priority: HIGHEST for action port [ 1145.080615] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1145.080755] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1145.080850] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b36acb-b1d1-438f-b2b1-43ee1597f479 with Priority: HIGHEST for action port [ 1145.081174] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.081259] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.081326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.081520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.081595] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.082417] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.082544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.082582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.082842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.082942] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.083024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.083090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.083231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.083315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.084018] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.084179] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-07b36acb-b1d1-438f-b2b1-43ee1597f479 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.084600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.084600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.084600] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.084600] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07b36acb-b1d1-438f-b2b1-43ee1597f479',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.586691] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.587997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.587997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.587997] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07b36acb-b1d1-438f-b2b1-43ee1597f479 with status ACTIVE [ 1145.588492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.588492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.588492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.588927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.588927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.588927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.588927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.588927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.589505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.589505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.589505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.589968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.589968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.589968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.590464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.590464] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07b36acb-b1d1-438f-b2b1-43ee1597f479 is going to be updated. [ 1145.615434] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.615616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.615616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.615792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.616036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.616193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07b36acb-b1d1-438f-b2b1-43ee1597f479" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.092394] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.594754] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.594954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.595057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.595227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.595336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.595443] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be created. [ 1146.623749] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.624052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.624052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.624199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.624364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.634320] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: UNINITIALIZED for 2s [ 1147.541684] env[65381]: INFO networking_nsxv3.common.synchronization [req-9b0a9ac8-c875-44a8-b436-c2da5df2b214 req-372055fd-83ad-4b39-a9be-5bcc4ee0ad7b tempest-ServerMetadataNegativeTestJSON-1635290466 tempest-ServerMetadataNegativeTestJSON-1635290466-project-member] Enqueued Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_members [ 1147.543142] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_members [ 1147.543142] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.543142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.543142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.543142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.543142] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.543752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.543752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.543752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.543752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.543752] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.839390] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-979 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.839587] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-979" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.839712] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-979" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.840073] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-979" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.840345] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.840507] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.840621] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.840887] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.841042] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.841253] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.841365] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.841468] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.841572] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.841676] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.841777] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.841902] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.862151] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.862381] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.862527] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.862709] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-979" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.863074] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-0603f798-e6e3-474f-8da7-8ac124299415 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.863232] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.863352] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.863741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.863969] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0603f798-e6e3-474f-8da7-8ac124299415',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.911136] env[65381]: INFO networking_nsxv3.common.synchronization [req-1e542a5d-bafb-4aff-a7c9-c8791f50fd87 req-cb1b8f12-657d-43ea-9b5d-7330e2303665 tempest-ServersTestJSON-873172192 tempest-ServersTestJSON-873172192-project-member] Enqueued Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1147.911884] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 with Priority: HIGHEST for action security_group_members [ 1147.912309] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.912370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.912416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.912591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.912737] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.912834] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.912896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.913050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.913134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.913227] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.046150] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.046331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.046503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.046733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.046955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.047189] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.047316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.047389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.047623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.047713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.047812] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7660b898-6ec7-4760-b27c-7cb825cac126 already deleted. [ 1148.047895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.366889] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.367259] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.367412] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.367754] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.367894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.368106] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 0603f798-e6e3-474f-8da7-8ac124299415 not found, creating... [ 1148.368726] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.368901] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.369033] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.369262] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.369425] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.369790] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.370079] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.370177] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.370399] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.370559] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.370705] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 0603f798-e6e3-474f-8da7-8ac124299415 is going to be created. [ 1148.390225] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.390443] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.390553] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.390812] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.391040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.391261] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.415227] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.415404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.415484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.415712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.415821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.416077] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.416222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.416349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.416532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.416640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.416755] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 is going to be updated. [ 1148.448604] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.448845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.448916] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.449225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.449374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.466400] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: IN_PROGRESS for 2s [ 1148.646150] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1148.646457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.646680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.647213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.647498] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.647691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.647867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.648173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.648342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.648485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.648646] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.147436] env[65381]: INFO networking_nsxv3.common.synchronization [req-9b0a9ac8-c875-44a8-b436-c2da5df2b214 req-199c33ca-c759-4478-b020-dbc6530c2115 service nova] Enqueued Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_rules [ 1149.147547] env[65381]: INFO networking_nsxv3.common.synchronization [req-9b0a9ac8-c875-44a8-b436-c2da5df2b214 req-199c33ca-c759-4478-b020-dbc6530c2115 service nova] Enqueued Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_members [ 1149.147596] env[65381]: INFO networking_nsxv3.common.synchronization [req-9b0a9ac8-c875-44a8-b436-c2da5df2b214 req-199c33ca-c759-4478-b020-dbc6530c2115 service nova] Enqueued Resource ID: 0603f798-e6e3-474f-8da7-8ac124299415 with Priority: HIGHEST for action port [ 1149.148219] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_rules [ 1149.148463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_members [ 1149.148463] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0603f798-e6e3-474f-8da7-8ac124299415 with Priority: HIGHEST for action port [ 1149.148736] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.148858] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.148944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.149308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.149308] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.150475] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.150475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.150475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.150603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.151013] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.151013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.151013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.152337] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.152439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.152545] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.153891] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0603f798-e6e3-474f-8da7-8ac124299415 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.154068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.154127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.154286] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.154366] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0603f798-e6e3-474f-8da7-8ac124299415',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.156471] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.656637] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.656637] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.658115] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0603f798-e6e3-474f-8da7-8ac124299415 with status ACTIVE [ 1149.658316] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.659043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.659043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.659043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.659043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.659043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.659043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.659396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.659396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.659396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.659501] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.659581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.659738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.659799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.659854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.659924] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0603f798-e6e3-474f-8da7-8ac124299415 is going to be updated. [ 1149.661540] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.664781] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b833f6e1-94c4-4ead-8d63-74d29b12d7a2: rpc.has_security_group_logging(os_id): False [ 1149.678684] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.678824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.678880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.679984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.679984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.679984] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.679984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.679984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.679984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.679984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.679984] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be created. [ 1149.684771] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.684896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.684963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.685169] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.685300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.685447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0603f798-e6e3-474f-8da7-8ac124299415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.743434] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.743584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.743645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.743831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.744041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.771634] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: IN_PROGRESS for 2s [ 1150.167271] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.477426] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 in Status: SUCCESS [ 1150.477663] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61 deletion is rescheduled due to dependency. [ 1150.477727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.668919] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.669357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.669477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.669724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.669819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.670014] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7660b898-6ec7-4760-b27c-7cb825cac126 is going to be created. [ 1150.697709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.697905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.697986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.698179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.698344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.711415] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7660b898-6ec7-4760-b27c-7cb825cac126 in Status: UNINITIALIZED for 2s [ 1151.623724] env[65381]: INFO networking_nsxv3.common.synchronization [req-054d70cc-d0b0-4f35-a55d-8e9fe6768ccf req-3514b07d-c6e7-4df9-bbd3-e9587fc58359 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1151.624845] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1151.625313] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.625480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.625584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.625918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.626115] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.626273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.626374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.626607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.626737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.626883] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.788147] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1151.788581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.946049] env[65381]: INFO networking_nsxv3.common.synchronization [req-156db8d1-b15f-4f77-b352-44f8582026ad req-bd012f64-db3c-4d63-8d5f-f295625682c2 tempest-ServerRescueNegativeTestJSON-1123207150 tempest-ServerRescueNegativeTestJSON-1123207150-project-member] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 1151.946049] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGHEST for action security_group_members [ 1151.946049] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.946049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.946049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.946049] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.946049] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.946296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.946296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.946454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.946529] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.946624] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.999294] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.999588] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.999754] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.000095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.000420] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.000621] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.000791] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.001082] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.001262] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.001499] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.001621] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.001745] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.001868] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.001998] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.002127] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.002257] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.022121] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.022320] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.022463] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.022649] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-983" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.022969] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-21049d84-e99e-4fce-a91f-68aa4609eccf taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.023209] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.023345] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.023680] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.023819] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21049d84-e99e-4fce-a91f-68aa4609eccf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.129965] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.449480] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.449720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.449799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.450036] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.450140] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.450346] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.450454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.450721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.450919] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.451030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.451159] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be updated. [ 1152.478485] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.478657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.478734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.478939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.479095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.488341] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: IN_PROGRESS for 2s [ 1152.532960] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.533301] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.533435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.533729] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.533899] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.534114] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 21049d84-e99e-4fce-a91f-68aa4609eccf not found, creating... [ 1152.534430] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.534634] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.534759] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.535011] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.535205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.535551] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.535716] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.535837] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.536145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.536291] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.536436] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 21049d84-e99e-4fce-a91f-68aa4609eccf is going to be created. [ 1152.557807] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.558052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.558188] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.558457] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.558696] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.558932] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.632622] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.725838] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7660b898-6ec7-4760-b27c-7cb825cac126 in Status: SUCCESS [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.728463] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.728463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.728463] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.135028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.135367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.135367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.135430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.135526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.135634] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 1153.173240] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.173449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.173574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.173939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.174109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.185971] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 1153.230847] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.231176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.231176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.231427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.231648] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.231761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.231848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.231973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.232076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.232155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.235516] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.235516] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.235516] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.235516] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.297431] env[65381]: INFO networking_nsxv3.common.synchronization [req-054d70cc-d0b0-4f35-a55d-8e9fe6768ccf req-32749ccf-9f35-4efe-b004-71ee5d35ca53 service nova] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 1153.297622] env[65381]: INFO networking_nsxv3.common.synchronization [req-054d70cc-d0b0-4f35-a55d-8e9fe6768ccf req-32749ccf-9f35-4efe-b004-71ee5d35ca53 service nova] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1153.297760] env[65381]: INFO networking_nsxv3.common.synchronization [req-054d70cc-d0b0-4f35-a55d-8e9fe6768ccf req-32749ccf-9f35-4efe-b004-71ee5d35ca53 service nova] Enqueued Resource ID: 21049d84-e99e-4fce-a91f-68aa4609eccf with Priority: HIGHEST for action port [ 1153.298373] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_rules [ 1153.298535] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1153.298636] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21049d84-e99e-4fce-a91f-68aa4609eccf with Priority: HIGHEST for action port [ 1153.299934] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.300827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.300917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.301135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.301224] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.302785] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.302902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.303129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-21049d84-e99e-4fce-a91f-68aa4609eccf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.303266] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.303328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.303583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.303632] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21049d84-e99e-4fce-a91f-68aa4609eccf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.738318] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7660b898-6ec7-4760-b27c-7cb825cac126: rpc.has_security_group_logging(os_id): False [ 1153.757126] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.757389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.757463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.757707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.757759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.758323] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.758323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.758323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.758323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.758731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.758731] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.758731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.758731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.758874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.758874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.759071] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.759295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.759295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.759402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.759473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.759557] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7660b898-6ec7-4760-b27c-7cb825cac126 is going to be created. [ 1153.807038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.807038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.807038] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21049d84-e99e-4fce-a91f-68aa4609eccf with status ACTIVE [ 1153.807517] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.807517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.807517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.807517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.807646] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.808014] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.808014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.808283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.808283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.808283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.808488] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.808583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.808645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.808915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.808915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.809037] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21049d84-e99e-4fce-a91f-68aa4609eccf is going to be updated. [ 1153.834536] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.834684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.834752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.834972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.835153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.835318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21049d84-e99e-4fce-a91f-68aa4609eccf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.851710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.851849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.851907] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.852147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.852304] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.872421] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7660b898-6ec7-4760-b27c-7cb825cac126 in Status: IN_PROGRESS for 2s [ 1154.500139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 in Status: SUCCESS [ 1154.500511] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 deletion is rescheduled due to dependency. [ 1154.500511] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.199028] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.199028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.199028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.199028] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.700687] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.886615] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7660b898-6ec7-4760-b27c-7cb825cac126 in Status: SUCCESS [ 1155.886989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.176311] env[65381]: INFO networking_nsxv3.common.synchronization [None req-93b6ce7e-7c3b-4cd1-8597-0969facb95ff None None] Enqueued Resource ID: f7acec7c-d8b9-43a9-b132-360f3213b8f5 with Priority: HIGHEST for action port [ 1156.176955] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7acec7c-d8b9-43a9-b132-360f3213b8f5 with Priority: HIGHEST for action port [ 1156.177352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7acec7c-d8b9-43a9-b132-360f3213b8f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.177493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7acec7c-d8b9-43a9-b132-360f3213b8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.177562] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7acec7c-d8b9-43a9-b132-360f3213b8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.177817] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7acec7c-d8b9-43a9-b132-360f3213b8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.177898] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7acec7c-d8b9-43a9-b132-360f3213b8f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.203382] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.681492] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7acec7c-d8b9-43a9-b132-360f3213b8f5 [ 1156.681492] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.681492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.681492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.681664] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.681695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.681799] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7acec7c-d8b9-43a9-b132-360f3213b8f5 already deleted. [ 1156.681880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7acec7c-d8b9-43a9-b132-360f3213b8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.706424] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.706727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.706727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.706983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.707056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.707118] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 1156.757639] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.759924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.759924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.759924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.759924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.774601] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 1158.413626] env[65381]: INFO networking_nsxv3.common.synchronization [None req-83aee67e-b7d8-4552-ad68-345b28968728 None None] Enqueued Resource ID: 0e403f28-1d48-4fa2-aa47-c1175aadc8f5 with Priority: HIGHEST for action port [ 1158.413626] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e403f28-1d48-4fa2-aa47-c1175aadc8f5 with Priority: HIGHEST for action port [ 1158.413626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e403f28-1d48-4fa2-aa47-c1175aadc8f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.413626] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e403f28-1d48-4fa2-aa47-c1175aadc8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.415443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e403f28-1d48-4fa2-aa47-c1175aadc8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.415443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e403f28-1d48-4fa2-aa47-c1175aadc8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.415443] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e403f28-1d48-4fa2-aa47-c1175aadc8f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.787243] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 1158.787503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.787736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.787989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.788237] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.788386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.788686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.788686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.788783] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.788866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.788988] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.918297] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e403f28-1d48-4fa2-aa47-c1175aadc8f5 [ 1158.918566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.918725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.918794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.919035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.919139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.919248] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e403f28-1d48-4fa2-aa47-c1175aadc8f5 already deleted. [ 1158.919335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e403f28-1d48-4fa2-aa47-c1175aadc8f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.291772] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.794768] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9694af19-2e42-4299-8799-3ccc40da653d: rpc.has_security_group_logging(os_id): False [ 1159.935716] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.935967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.936058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.936428] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.936560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.936969] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.937313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.937313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.937473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.937586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.937710] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 1160.010768] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.010967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.010967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.011299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.011462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.029758] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 1160.821231] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5db09d58-48dd-48a6-8ea6-4b2afd39860e None None] Enqueued Resource ID: 398236b9-b4f9-4174-94e6-e7f74257660d with Priority: HIGHEST for action port [ 1160.821787] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398236b9-b4f9-4174-94e6-e7f74257660d with Priority: HIGHEST for action port [ 1160.822118] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-398236b9-b4f9-4174-94e6-e7f74257660d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.822342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-398236b9-b4f9-4174-94e6-e7f74257660d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.822342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-398236b9-b4f9-4174-94e6-e7f74257660d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.822553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-398236b9-b4f9-4174-94e6-e7f74257660d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.822635] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('398236b9-b4f9-4174-94e6-e7f74257660d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.846985] env[65381]: INFO networking_nsxv3.common.synchronization [req-9e09b4ce-1770-4ae6-8b1f-88491cf588a7 req-e4e09eae-3647-4850-b5e6-790b906ab10c tempest-ServerMetadataNegativeTestJSON-1635290466 tempest-ServerMetadataNegativeTestJSON-1635290466-project-member] Enqueued Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_members [ 1160.847664] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGHEST for action security_group_members [ 1160.847998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.848680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.848680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.848848] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.849091] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.849156] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.849217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.849400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.849531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.849653] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.324884] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 398236b9-b4f9-4174-94e6-e7f74257660d [ 1161.324996] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.325158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.325158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.325680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.325680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.325680] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:398236b9-b4f9-4174-94e6-e7f74257660d already deleted. [ 1161.325680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-398236b9-b4f9-4174-94e6-e7f74257660d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.353987] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.353987] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.353987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.353987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7660b898-6ec7-4760-b27c-7cb825cac126 is going to be updated. [ 1161.387331] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.387479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.387549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.387752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.387892] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.397887] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7660b898-6ec7-4760-b27c-7cb825cac126 in Status: IN_PROGRESS for 2s [ 1161.501259] env[65381]: INFO networking_nsxv3.common.synchronization [None req-dc2454c2-a443-47a0-aed7-95b209193bc9 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_rules [ 1161.501792] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_rules [ 1161.502202] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.502352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.502422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.502695] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.502781] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.590635] env[65381]: INFO networking_nsxv3.common.synchronization [None req-ddbbdb05-9384-485e-a468-721ad2d4ba09 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_rules [ 1161.591075] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_rules [ 1161.591582] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.591582] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.028856] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.029422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.029422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.029422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.029832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.029832] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb442c62-d788-4f5d-a473-ba31d928824c already deleted. [ 1162.029832] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.029918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.032674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.032674] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.046342] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 1162.046572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.554293] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.554455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.554510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.554730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.554818] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.554929] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb442c62-d788-4f5d-a473-ba31d928824c already deleted. [ 1162.554987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.781467] env[65381]: INFO networking_nsxv3.common.synchronization [req-dad6a120-7132-4ef2-9133-ee9b23716cac req-da34fcfd-4dc8-40ee-a5b3-9abef0fdd0b9 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1162.782874] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1162.783683] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.783896] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.784072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.784534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.785099] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.785207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.785324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.785587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.785713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.785853] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.061507] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c29df005-ce07-427a-aa25-8a51fef7e652 None None] Enqueued Resource ID: 44b8e9de-e0ad-4c61-acd5-e0f03779c33f with Priority: HIGHEST for action port [ 1163.062334] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b8e9de-e0ad-4c61-acd5-e0f03779c33f with Priority: HIGHEST for action port [ 1163.062414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-44b8e9de-e0ad-4c61-acd5-e0f03779c33f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.062576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44b8e9de-e0ad-4c61-acd5-e0f03779c33f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.062752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44b8e9de-e0ad-4c61-acd5-e0f03779c33f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.065564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44b8e9de-e0ad-4c61-acd5-e0f03779c33f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.065564] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b8e9de-e0ad-4c61-acd5-e0f03779c33f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.172186] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.172347] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.172473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.172738] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.172995] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.173169] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.173285] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.173528] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.173674] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.173885] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.173996] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.174158] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.174276] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.174389] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.174498] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.174628] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.195029] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.195935] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.195935] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.195935] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.195935] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-c5cb39d2-2605-47da-94f4-fd495468e7cf taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.196185] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.196223] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.196539] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.196670] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5cb39d2-2605-47da-94f4-fd495468e7cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.288353] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.411098] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7660b898-6ec7-4760-b27c-7cb825cac126 in Status: SUCCESS [ 1163.411289] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7660b898-6ec7-4760-b27c-7cb825cac126 deletion is rescheduled due to dependency. [ 1163.411399] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.567600] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44b8e9de-e0ad-4c61-acd5-e0f03779c33f [ 1163.567808] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.568033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.568113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.568342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.568454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.568549] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44b8e9de-e0ad-4c61-acd5-e0f03779c33f already deleted. [ 1163.568636] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44b8e9de-e0ad-4c61-acd5-e0f03779c33f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.699690] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.699919] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.700058] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.700342] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.700487] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.700639] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port c5cb39d2-2605-47da-94f4-fd495468e7cf not found, creating... [ 1163.700886] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.701053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.701193] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.701437] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.701904] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.701904] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.702089] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.702187] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.702403] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.702533] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.702667] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: c5cb39d2-2605-47da-94f4-fd495468e7cf is going to be created. [ 1163.723449] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.723666] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.723882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.724223] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.724470] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.724707] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.790840] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.295634] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.295634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.295634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.295634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.295634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.295634] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be updated. [ 1164.327827] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.327827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.327827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.327827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.327827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.336854] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: IN_PROGRESS for 2s [ 1164.472905] env[65381]: INFO networking_nsxv3.common.synchronization [req-dad6a120-7132-4ef2-9133-ee9b23716cac req-eefdde75-50d3-4725-81e1-ef4d3b051dd7 service nova] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1164.473108] env[65381]: INFO networking_nsxv3.common.synchronization [req-dad6a120-7132-4ef2-9133-ee9b23716cac req-eefdde75-50d3-4725-81e1-ef4d3b051dd7 service nova] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1164.473275] env[65381]: INFO networking_nsxv3.common.synchronization [req-dad6a120-7132-4ef2-9133-ee9b23716cac req-eefdde75-50d3-4725-81e1-ef4d3b051dd7 service nova] Enqueued Resource ID: c5cb39d2-2605-47da-94f4-fd495468e7cf with Priority: HIGHEST for action port [ 1164.473787] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_rules [ 1164.473925] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1164.474049] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cb39d2-2605-47da-94f4-fd495468e7cf with Priority: HIGHEST for action port [ 1164.474381] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.474504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.474599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.474808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.474895] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.475774] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.475868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.476335] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5cb39d2-2605-47da-94f4-fd495468e7cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.476335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.476335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.476499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.476499] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5cb39d2-2605-47da-94f4-fd495468e7cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.978735] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.978901] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.979059] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5cb39d2-2605-47da-94f4-fd495468e7cf with status ACTIVE [ 1164.979229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.979340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.979404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.979621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.979709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.980336] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.980336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.980336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.980336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.980336] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.980494] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.980494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.980569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.980683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.980752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.980836] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5cb39d2-2605-47da-94f4-fd495468e7cf is going to be updated. [ 1165.004986] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.005295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.005379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.005777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.005993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.006354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5cb39d2-2605-47da-94f4-fd495468e7cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.187519] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ac9aaf2-b91e-4c14-b081-dae8c6c15755 req-c311fe3b-0bad-4c60-9085-3f65e7714205 tempest-ServersNegativeTestJSON-1064847459 tempest-ServersNegativeTestJSON-1064847459-project-member] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1165.188442] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1165.188581] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.188655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.188716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.188963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.189342] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.189342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.189342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.189519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.189585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.189709] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.547937] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.547937] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.547937] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.547937] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.547937] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.547937] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.547937] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.549050] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.549406] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.550286] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.551031] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.551031] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.551031] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.551031] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.551031] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.551031] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.574172] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.574371] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.574505] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.574678] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.574986] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-217522fd-a0c3-4573-be1f-f921ccfa5ed2 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.575187] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.575303] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.575605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.575739] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217522fd-a0c3-4573-be1f-f921ccfa5ed2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.692187] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.692350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.692417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.692628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.692710] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.692912] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.693038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.693104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.693226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.693306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.693416] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad already deleted. [ 1165.693466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.078011] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.078295] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.078455] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.078793] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.078977] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.079177] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 217522fd-a0c3-4573-be1f-f921ccfa5ed2 not found, creating... [ 1166.079478] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.079863] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.079863] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.080081] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.080235] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.080520] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.080709] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.080789] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.080996] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.081145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.081284] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 is going to be created. [ 1166.101840] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.102072] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.102189] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.102458] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.102774] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.103031] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.346987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1166.346987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.346987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.346987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.347279] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.347279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.347279] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.347472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.347472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.347624] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.799557] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ac9aaf2-b91e-4c14-b081-dae8c6c15755 req-91217120-43ea-44a7-a0e4-03ae41adfa5c service nova] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_rules [ 1166.799831] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ac9aaf2-b91e-4c14-b081-dae8c6c15755 req-91217120-43ea-44a7-a0e4-03ae41adfa5c service nova] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1166.800028] env[65381]: INFO networking_nsxv3.common.synchronization [req-6ac9aaf2-b91e-4c14-b081-dae8c6c15755 req-91217120-43ea-44a7-a0e4-03ae41adfa5c service nova] Enqueued Resource ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 with Priority: HIGHEST for action port [ 1166.800775] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_rules [ 1166.801016] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1166.801111] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 with Priority: HIGHEST for action port [ 1166.801524] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.801721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.801895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.802285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.802450] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.803719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.803877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.803959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.804382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.804589] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.804774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.804884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.805161] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.805296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.805491] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.806671] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-217522fd-a0c3-4573-be1f-f921ccfa5ed2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.806671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.806671] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.810215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.810215] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217522fd-a0c3-4573-be1f-f921ccfa5ed2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.850720] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.310394] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.310394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.310394] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.312095] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 217522fd-a0c3-4573-be1f-f921ccfa5ed2 with status ACTIVE [ 1167.312459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.312736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.312922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.313295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.313509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.314057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.314306] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.314462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.314766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.314969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.315279] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.315539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.316345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.316345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.316345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.316345] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 is going to be updated. [ 1167.342128] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.342128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.342128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.342128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.342128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.342128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.355142] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.812555] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.859844] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.860040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.860091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.860278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.860392] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.860494] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be updated. [ 1167.895227] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.895413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.895863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.895863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.896102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.910398] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: IN_PROGRESS for 2s [ 1168.314727] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.314943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.315111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.315432] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.315589] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.315752] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be created. [ 1168.343226] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.343427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.343427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.343680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.343803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.355264] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: UNINITIALIZED for 2s [ 1169.295246] env[65381]: INFO networking_nsxv3.common.synchronization [req-9ef23eeb-d3ad-4871-8cf4-f0c502fe2560 req-06a69cfe-7b4a-46c6-9936-dc9c6969bc90 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_members [ 1169.295752] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_members [ 1169.296113] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.296319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.296385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.296641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.296799] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.296899] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.296960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.297128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.297221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.297343] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.597143] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.597724] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.597724] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.597948] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.598240] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.598631] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.598631] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.598984] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.599194] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.599447] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.600335] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.600335] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.600335] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.600335] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.600335] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.600335] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.622803] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.622803] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.622803] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.622994] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.623241] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-b47c72d0-a3b7-44d0-80e1-2544551aa415 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.623422] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.623540] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.623882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.624032] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47c72d0-a3b7-44d0-80e1-2544551aa415',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.800208] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.800489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.800566] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.800830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.800934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.801232] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.801414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.801414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.801620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.801681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.801769] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb442c62-d788-4f5d-a473-ba31d928824c already deleted. [ 1169.801851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.920695] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1169.921753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.921753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.921753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.921753] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.921753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.921753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.922051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.922051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.922127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.922183] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.126374] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.126744] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.126744] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.127145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.127375] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.127576] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port b47c72d0-a3b7-44d0-80e1-2544551aa415 not found, creating... [ 1170.127961] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.128162] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.128309] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.128585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.128731] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.129110] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.129351] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.129490] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.129761] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.129918] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.130149] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: b47c72d0-a3b7-44d0-80e1-2544551aa415 is going to be created. [ 1170.173055] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.173289] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.173410] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.173715] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.173953] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.174322] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.366034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1170.366372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.366438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.366661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.366855] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.366977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.367055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.367212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.367294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.367404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.367497] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.424397] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.859591] env[65381]: INFO networking_nsxv3.common.synchronization [req-9ef23eeb-d3ad-4871-8cf4-f0c502fe2560 req-dbe779d5-3977-485b-9d06-0c8d1fdbe1fc service nova] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_rules [ 1170.859779] env[65381]: INFO networking_nsxv3.common.synchronization [req-9ef23eeb-d3ad-4871-8cf4-f0c502fe2560 req-dbe779d5-3977-485b-9d06-0c8d1fdbe1fc service nova] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_members [ 1170.859916] env[65381]: INFO networking_nsxv3.common.synchronization [req-9ef23eeb-d3ad-4871-8cf4-f0c502fe2560 req-dbe779d5-3977-485b-9d06-0c8d1fdbe1fc service nova] Enqueued Resource ID: b47c72d0-a3b7-44d0-80e1-2544551aa415 with Priority: HIGHEST for action port [ 1170.860439] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_rules [ 1170.860569] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_members [ 1170.860667] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c72d0-a3b7-44d0-80e1-2544551aa415 with Priority: HIGHEST for action port [ 1170.860937] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.861099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.861166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.861398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.861507] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.862658] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.862770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.862838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.863027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.863284] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.863284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.863400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.863464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.863548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.863639] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.864719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47c72d0-a3b7-44d0-80e1-2544551aa415 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.864719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.864719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.865055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.865055] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47c72d0-a3b7-44d0-80e1-2544551aa415',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.870044] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.870177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.870248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.870424] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.870579] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.870679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.870768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.870879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.871429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.871429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.871429] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.871429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.871429] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.871725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.871725] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.871725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.871894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.871929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.871976] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.872072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.872157] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.926459] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b833f6e1-94c4-4ead-8d63-74d29b12d7a2: rpc.has_security_group_logging(os_id): False [ 1170.948570] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.948731] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.948801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.949052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.949174] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.949432] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.949538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.949602] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.949765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.949844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.949956] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be updated. [ 1171.037869] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.038029] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.038101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.038386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.038578] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.058783] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: IN_PROGRESS for 2s [ 1171.367085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.367085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.367576] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.368279] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b47c72d0-a3b7-44d0-80e1-2544551aa415 with status ACTIVE [ 1171.368476] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.368603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.368667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.368862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.368970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.369105] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.369241] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.369294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.369453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.369526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.369707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.369851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.369851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.369993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.370054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.370139] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b47c72d0-a3b7-44d0-80e1-2544551aa415 is going to be updated. [ 1171.373903] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9effaefa-64b1-432a-88af-119a7ba350ad: rpc.has_security_group_logging(os_id): False [ 1171.393348] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.393621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.393621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.393764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.393894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.394080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47c72d0-a3b7-44d0-80e1-2544551aa415" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.395013] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.395129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.395182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.395351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.395458] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.395651] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.395751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.395816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.395962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.396054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.396263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.396391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.396470] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.396599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.396674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.396911] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.397016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.397080] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.397250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.397366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.397366] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be created. [ 1171.480023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.480257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.480374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.480684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.480959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.524541] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1171.634437] env[65381]: INFO networking_nsxv3.common.synchronization [req-14688746-9847-4d6f-b010-ebb6567529eb req-39d8fd45-df74-45ba-825b-a012a9e64250 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1171.635427] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1171.635500] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.635585] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.635661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.635882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.636093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.636182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.636221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.636367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.636453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.636791] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.871944] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.138935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.138935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.139077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.139205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.139290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.139554] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.139721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.139721] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.139815] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.139889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.139978] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1172.176171] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.176466] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.176571] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.176824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.176980] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.188991] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1172.374860] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.374860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.374860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.374860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.374860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.374860] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb442c62-d788-4f5d-a473-ba31d928824c is going to be created. [ 1172.407568] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.407813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.407902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.408205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.408489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.424728] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb442c62-d788-4f5d-a473-ba31d928824c in Status: UNINITIALIZED for 2s [ 1172.465698] env[65381]: INFO networking_nsxv3.common.synchronization [req-d15035d0-8a10-48a0-b4f7-2e4fb989b823 req-a79a6ec4-4009-475f-a387-80120d9b0138 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1172.466871] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGHEST for action security_group_members [ 1172.466871] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.466871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.467170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.467170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.467652] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.467652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.467652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.467652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.467652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.467921] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.971109] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.971395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.971395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.971800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.971800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.971989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.971989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.972157] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.972263] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.972334] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.972400] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 is going to be updated. [ 1173.002039] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.002247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.002247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.002465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.002684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.013103] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: IN_PROGRESS for 2s [ 1173.092563] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1173.092743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.538511] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1173.538876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.199204] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1174.199398] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 deletion is rescheduled due to dependency. [ 1174.199493] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.435090] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb442c62-d788-4f5d-a473-ba31d928824c in Status: SUCCESS [ 1174.435315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.435482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.435705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.435890] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.436010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.436077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.436230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.436335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.436453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.436552] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.939642] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.025289] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 in Status: SUCCESS [ 1175.025289] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 deletion is rescheduled due to dependency. [ 1175.025289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.443080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb442c62-d788-4f5d-a473-ba31d928824c: rpc.has_security_group_logging(os_id): False [ 1175.465388] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.465670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.465827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.466094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.466195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.466785] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.466785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.466785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.467040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.467163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.467228] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb442c62-d788-4f5d-a473-ba31d928824c is going to be created. [ 1175.486124] env[65381]: INFO networking_nsxv3.common.synchronization [None req-e52aaa10-ad70-4df3-bc01-7e16461b4525 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1175.486775] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1175.487118] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.487349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.487349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.487541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.487701] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.487801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.487863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.488018] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.488104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.488195] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.538994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.538994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.539228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.539801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.539801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.551520] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb442c62-d788-4f5d-a473-ba31d928824c in Status: IN_PROGRESS for 2s [ 1175.990717] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.991225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.991225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.991225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.991347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.991591] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.991705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.991778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.991964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.992061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.992167] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1176.020681] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.020889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.020941] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.021149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.021504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.031067] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1177.564465] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb442c62-d788-4f5d-a473-ba31d928824c in Status: SUCCESS [ 1177.564465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.041894] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1178.042098] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b deletion is rescheduled due to dependency. [ 1178.042251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.503847] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c70965e1-8208-4b82-8a56-cb6d1741c87f tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1178.504403] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1178.504752] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.504883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.504952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.505220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.505304] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.603745] env[65381]: INFO networking_nsxv3.common.synchronization [None req-2a307796-f9d0-4394-b76e-d748b9d7bd40 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1178.604250] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1178.604709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.604790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.027025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.027025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.027025] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.027282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.027410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.027469] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f already deleted. [ 1179.027548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.027703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.027911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.027964] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.550159] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.550264] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.550330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.550536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.550625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.550732] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f already deleted. [ 1179.550797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.390081] env[65381]: INFO networking_nsxv3.common.synchronization [req-ccf6dd3d-41e5-4bba-972c-70b9f1555f3f req-10bf7efa-c4de-4e08-bc7e-d6fadca0f8db tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1181.390785] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1181.391140] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.391284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.391328] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.391546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.391710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.391812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.391875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.392054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.392137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.392334] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.680179] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.680428] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.680507] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.680900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.681238] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.681433] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.681581] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.681833] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.682055] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.682280] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.682397] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.682502] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.682612] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.682717] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.682819] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.682951] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.707529] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.707743] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.707801] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.707990] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-594" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.708336] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-a4e663dd-f911-4e07-9ec4-511c69a797ec taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.708545] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.708678] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.709257] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.709257] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4e663dd-f911-4e07-9ec4-511c69a797ec',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.894863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.895110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.895159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.895384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.895441] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.895635] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.895796] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.895894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.896044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.896123] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.896210] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1181.930443] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.930443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.930443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.930443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.930443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.940008] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1182.211668] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.211879] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.212044] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.212354] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.212506] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.212704] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port a4e663dd-f911-4e07-9ec4-511c69a797ec not found, creating... [ 1182.213013] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.213191] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.213313] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.213521] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.213657] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.213939] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.214106] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.214222] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.214435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.214561] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.214702] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: a4e663dd-f911-4e07-9ec4-511c69a797ec is going to be created. [ 1182.237741] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.237961] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.238099] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.238418] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.238670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.238898] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.945672] env[65381]: INFO networking_nsxv3.common.synchronization [req-ccf6dd3d-41e5-4bba-972c-70b9f1555f3f req-b7f87d19-8fee-455a-8a93-84d811fd75b1 service nova] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 1182.945932] env[65381]: INFO networking_nsxv3.common.synchronization [req-ccf6dd3d-41e5-4bba-972c-70b9f1555f3f req-b7f87d19-8fee-455a-8a93-84d811fd75b1 service nova] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1182.945932] env[65381]: INFO networking_nsxv3.common.synchronization [req-ccf6dd3d-41e5-4bba-972c-70b9f1555f3f req-b7f87d19-8fee-455a-8a93-84d811fd75b1 service nova] Enqueued Resource ID: a4e663dd-f911-4e07-9ec4-511c69a797ec with Priority: HIGHEST for action port [ 1182.948264] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_rules [ 1182.948409] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1182.948517] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4e663dd-f911-4e07-9ec4-511c69a797ec with Priority: HIGHEST for action port [ 1182.949044] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.949176] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.949246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.949449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.949531] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.951460] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.951559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.951833] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4e663dd-f911-4e07-9ec4-511c69a797ec taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.951990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.952100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.952340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.952469] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4e663dd-f911-4e07-9ec4-511c69a797ec',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.454822] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.454966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.455158] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4e663dd-f911-4e07-9ec4-511c69a797ec with status ACTIVE [ 1183.455327] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.455440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.455509] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.455732] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.455820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.455993] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.456122] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.456166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.456312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.456423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.456588] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.456685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.456749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.456888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.456961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.457058] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4e663dd-f911-4e07-9ec4-511c69a797ec is going to be updated. [ 1183.477168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.477379] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.477433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.477617] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.477757] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.477914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4e663dd-f911-4e07-9ec4-511c69a797ec" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.565572] env[65381]: INFO networking_nsxv3.common.synchronization [req-fceedd37-f7de-45ef-83ea-0bb11a85492c req-1378e64a-5789-4e83-bbbc-088fe9d98897 tempest-ServersNegativeTestJSON-1064847459 tempest-ServersNegativeTestJSON-1064847459-project-member] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1183.566171] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1183.566552] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.566682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.566751] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.567104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.567146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.567219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.567281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.567455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.567551] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.567632] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.881205] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.881452] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.881675] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.881996] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.882300] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.882466] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.882582] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.882811] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.882985] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.883219] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.883332] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.883439] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.883546] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.883653] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.883754] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.883900] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.902146] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.902311] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.902445] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.902623] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.902930] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.903146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.903225] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.903546] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.903685] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.950016] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1183.950294] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 deletion is rescheduled due to dependency. [ 1183.950439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.950937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.951166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.951347] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.951482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.951565] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.951743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.951827] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.951933] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.070058] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.406317] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.406591] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.406722] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.407047] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.407209] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.407366] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c not found, creating... [ 1184.407621] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.407779] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.407897] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.408140] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.408274] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.408577] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.408748] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.408865] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.409086] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.409356] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.409356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c is going to be created. [ 1184.430130] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.430341] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.430473] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.430719] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.430942] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.431175] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.453549] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.572030] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.956134] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.075314] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.075651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.075776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.076090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.076222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.076363] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1185.107476] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.107724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.107843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.108152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.108307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.119022] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1185.139681] env[65381]: INFO networking_nsxv3.common.synchronization [req-fceedd37-f7de-45ef-83ea-0bb11a85492c req-9ce9e4f5-b4ed-4e70-8fbd-f6666ea09c88 service nova] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_rules [ 1185.139869] env[65381]: INFO networking_nsxv3.common.synchronization [req-fceedd37-f7de-45ef-83ea-0bb11a85492c req-9ce9e4f5-b4ed-4e70-8fbd-f6666ea09c88 service nova] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1185.140010] env[65381]: INFO networking_nsxv3.common.synchronization [req-fceedd37-f7de-45ef-83ea-0bb11a85492c req-9ce9e4f5-b4ed-4e70-8fbd-f6666ea09c88 service nova] Enqueued Resource ID: ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c with Priority: HIGHEST for action port [ 1185.140562] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_rules [ 1185.140701] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1185.140801] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c with Priority: HIGHEST for action port [ 1185.141217] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.141440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.141552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.141866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.141994] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.142950] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.143245] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.143491] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.143645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.143763] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.143981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.144119] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.459185] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.459185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.459185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.459185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.459185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.459185] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1185.485443] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.485443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.485443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.486604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.486604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.495367] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1185.645704] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.645904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.646047] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c with status ACTIVE [ 1185.646217] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.646327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.646389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.646645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.646723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.646896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.646989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.647056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.647222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.647312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.647469] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.647608] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.647657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.648013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.648013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.648013] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c is going to be updated. [ 1185.674912] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.675177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.675177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.675349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.675942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.675942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea8b96fd-1ff7-4bb9-a15a-6fb130b2e05c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.905307] env[65381]: INFO networking_nsxv3.common.synchronization [req-bad3b19e-66d0-40f0-aa7d-cb74bce5eee2 req-5ed2182b-0109-4f9f-aa4b-dcdbebbfe013 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1185.905881] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1185.906205] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.906329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.906395] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.906692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.906939] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.907103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.907190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.907376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.907530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.907684] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.240629] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.240976] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.240976] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.241218] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.241473] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.241625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.241739] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.241947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.242103] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.242306] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.242416] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.242521] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.242625] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.242726] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.242824] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.242946] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.261589] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.261769] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1186.261970] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.262165] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.262472] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-fcb330fe-f745-42c6-8d04-21d333a080cf taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.262670] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.262809] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.263144] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.263279] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb330fe-f745-42c6-8d04-21d333a080cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.409889] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.410069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.410115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.410322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.410410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.410601] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.410704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.410764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.410911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.410983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.411095] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f already deleted. [ 1186.411316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.766248] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.766523] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.766667] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.766955] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.767121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.767275] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port fcb330fe-f745-42c6-8d04-21d333a080cf not found, creating... [ 1186.767542] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.767719] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.767838] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.768069] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.768207] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.768488] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.768643] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.768827] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.769055] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.769191] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.769327] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: fcb330fe-f745-42c6-8d04-21d333a080cf is going to be created. [ 1186.792282] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.792529] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.792619] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.792889] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.793139] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.793374] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.133492] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1187.133724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.133905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.134155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.134356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.134539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.134616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.134785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.134867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.134966] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.492630] env[65381]: INFO networking_nsxv3.common.synchronization [req-bad3b19e-66d0-40f0-aa7d-cb74bce5eee2 req-264a481d-62af-4a7c-aec1-11f7b83fb91f service nova] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1187.492956] env[65381]: INFO networking_nsxv3.common.synchronization [req-bad3b19e-66d0-40f0-aa7d-cb74bce5eee2 req-264a481d-62af-4a7c-aec1-11f7b83fb91f service nova] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1187.492956] env[65381]: INFO networking_nsxv3.common.synchronization [req-bad3b19e-66d0-40f0-aa7d-cb74bce5eee2 req-264a481d-62af-4a7c-aec1-11f7b83fb91f service nova] Enqueued Resource ID: fcb330fe-f745-42c6-8d04-21d333a080cf with Priority: HIGHEST for action port [ 1187.493452] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1187.493576] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1187.493704] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcb330fe-f745-42c6-8d04-21d333a080cf with Priority: HIGHEST for action port [ 1187.493932] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.494467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.494552] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.494711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.494829] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.495787] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.497244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.497244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.497244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.497244] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.497244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.497244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.497244] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.497560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.497560] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.498459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcb330fe-f745-42c6-8d04-21d333a080cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.498459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.498459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.498800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.498800] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb330fe-f745-42c6-8d04-21d333a080cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.514274] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1187.514534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.514823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.514943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.515100] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.515221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.515289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.515460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.515554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.515645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.516083] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.638753] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.807440] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.807658] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.807787] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.808068] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.808319] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.808470] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.808587] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.808807] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.808948] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.809163] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.809273] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.809381] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.809484] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.809591] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.809692] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.809820] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.828187] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.828368] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1187.828505] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.828677] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.828982] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.829186] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.829310] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.829625] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.829769] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8ce1f-1b7f-4a25-8726-c2ede2b93902',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.000234] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.001281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.001460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.005657] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcb330fe-f745-42c6-8d04-21d333a080cf with status ACTIVE [ 1188.005657] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.005657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.005657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.005657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.005657] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.005939] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.005939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.005939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.006059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.006087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.006244] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.006354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.006396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.006954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.006954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.006954] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcb330fe-f745-42c6-8d04-21d333a080cf is going to be updated. [ 1188.019574] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.026978] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.027224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.027312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.027693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.027851] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.028019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.141696] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.331988] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.332470] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.332630] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.332931] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.333097] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.333259] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 not found, creating... [ 1188.333538] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.333707] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.333820] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.334056] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.334194] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.334522] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.334762] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.334882] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.335105] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.335237] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.335377] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 is going to be created. [ 1188.359504] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.359871] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.360099] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.360592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.360864] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.361113] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.502842] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.520796] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 915a6b47-7bba-4851-9dc7-06e0692a5259: rpc.has_security_group_logging(os_id): False [ 1188.551994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.552277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.552277] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.552427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.552480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.552733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.552831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.552884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.553055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.553133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.553218] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1188.626353] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.626609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.626675] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.626863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.627020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.643034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1188.643765] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.643965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.643965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.644230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.644310] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.644579] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1188.688132] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.688410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.688410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.688596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.688753] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.699930] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1189.005345] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.005545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.005621] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.005839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.005927] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.006047] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be created. [ 1189.031252] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.031536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.031536] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.031803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.032057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.044467] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: UNINITIALIZED for 2s [ 1189.062449] env[65381]: INFO networking_nsxv3.common.synchronization [req-5427e6a9-d60a-483f-b1d4-2cc83bb86de2 req-1dcfba3c-f3eb-47d9-8fd0-af5613030904 service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1189.062646] env[65381]: INFO networking_nsxv3.common.synchronization [req-5427e6a9-d60a-483f-b1d4-2cc83bb86de2 req-1dcfba3c-f3eb-47d9-8fd0-af5613030904 service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1189.062844] env[65381]: INFO networking_nsxv3.common.synchronization [req-5427e6a9-d60a-483f-b1d4-2cc83bb86de2 req-1dcfba3c-f3eb-47d9-8fd0-af5613030904 service nova] Enqueued Resource ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 with Priority: HIGHEST for action port [ 1189.063537] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1189.063678] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1189.063838] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 with Priority: HIGHEST for action port [ 1189.064264] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.064618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.064714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.064948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.065048] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.066777] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.066999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.066999] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.067208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.067360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.067489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.067588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.067678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.067761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.068442] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.069944] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.070072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.070138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.070415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.070500] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8ce1f-1b7f-4a25-8726-c2ede2b93902',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.567494] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.567906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.570152] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.571956] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 with status ACTIVE [ 1189.572278] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.572426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.572510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.572743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.572826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.573019] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.573127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.573192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.573347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.573425] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.573609] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.573703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.573764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.573962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.574050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.574150] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 is going to be updated. [ 1189.598664] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.598875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.598875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.599147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.599347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.599561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.072637] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.575704] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.576214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.576214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.576214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.576326] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.576360] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1190.610436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.610660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.610660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.610875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.611043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.620014] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1190.656783] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1190.657009] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.708975] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 4s [ 1191.055133] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: SUCCESS [ 1191.055372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.055549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.055766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.055994] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.056150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.056219] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.056387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.056476] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.056588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.056666] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.558848] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.061792] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b920740-c3e2-4b99-9809-c5e2dc5ba69f: rpc.has_security_group_logging(os_id): False [ 1192.079763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.079961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.080016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.080223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.080312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.080553] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.080656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.080716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.080863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.080938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.081036] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be created. [ 1192.139390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.139613] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.139697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.139953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.140220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.152298] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: IN_PROGRESS for 2s [ 1192.631075] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1192.631272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.631403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.631633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.631912] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.632098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.632207] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.632400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.632487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.632641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.632755] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.719520] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1192.719741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.719924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.720260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.720356] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.720504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.720555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.720680] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.720762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.720924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.720924] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.135240] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.135612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.135612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.135738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.135882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.135988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.136184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.136242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.136305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.136390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.136580] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.136685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.136743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.136888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.137049] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.137146] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.137214] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.137351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.137416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.137499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.137591] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.222847] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.223081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.223081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.223240] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.223404] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.223517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.223581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.223808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.223808] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.223934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.224043] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.224138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.224197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.224338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.224483] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.224596] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.224658] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.224810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.224867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.224949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.225052] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.641454] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e855adc-3508-49b6-b8b1-1007e65b954b: rpc.has_security_group_logging(os_id): False [ 1193.660551] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.660773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.660889] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.661171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.661314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.661542] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.661670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.661755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.661960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.662086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.662311] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.662488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.665738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.665994] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.666132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.666406] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.666541] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.666642] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.666850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.667045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.667204] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1193.730729] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9effaefa-64b1-432a-88af-119a7ba350ad: rpc.has_security_group_logging(os_id): False [ 1193.737505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.737814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.737814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.737982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.738145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.751725] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.751931] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.752017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.752295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.752423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.752941] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.753106] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.753221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.753522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.753616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.753907] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.754052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.754154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.754322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.754404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.754682] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.754963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.754963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.755183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.755347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.755453] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1193.761782] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1193.856997] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.856997] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.857624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.857624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.857624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.897508] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1194.065142] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1194.065333] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1194.167356] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: SUCCESS [ 1194.167356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.778952] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1195.779363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.912593] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1195.912864] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.248848] env[65381]: INFO networking_nsxv3.common.synchronization [req-6c4ae9d1-84ef-464e-ac10-a5d28d42c87a req-f13a0787-e5e5-4f63-bd88-d34d9686eb63 tempest-ServersNegativeTestJSON-1064847459 tempest-ServersNegativeTestJSON-1064847459-project-member] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1197.249437] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1197.250034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.250034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.250034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.250436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.250436] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.250436] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.251217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.251217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.251217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.251217] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.753147] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.255429] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.758273] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.758688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.758774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.758995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.759097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.759222] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1198.793028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.793028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.793028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.793307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.793574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.803571] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1200.814395] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1200.814844] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.250875] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.251382] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1204.908466] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.908802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.908802] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.909079] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.909329] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.909485] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.909599] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.909812] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.909951] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.910169] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.910281] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1204.910399] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1204.910626] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1204.910710] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1204.910808] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1204.910959] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1204.935512] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1204.935725] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1204.935839] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1204.936016] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.936340] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.936515] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.936633] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.936966] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.937118] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8ce1f-1b7f-4a25-8726-c2ede2b93902',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.439341] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.439613] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.439749] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.440040] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.440192] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.440485] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.440642] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.440760] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.440972] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.441123] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.441418] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.441543] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.441758] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.441947] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.442090] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.442231] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 is going to be updated. [ 1205.463105] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.463328] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.463435] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.463738] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.463912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.464155] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.152520] env[65381]: INFO networking_nsxv3.common.synchronization [req-e3c0c7ac-d5e8-46b5-a2f3-160c4c280386 req-0a99e8de-ee20-49a1-8251-449342c9d024 service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1206.152784] env[65381]: INFO networking_nsxv3.common.synchronization [req-e3c0c7ac-d5e8-46b5-a2f3-160c4c280386 req-0a99e8de-ee20-49a1-8251-449342c9d024 service nova] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1206.152847] env[65381]: INFO networking_nsxv3.common.synchronization [req-e3c0c7ac-d5e8-46b5-a2f3-160c4c280386 req-0a99e8de-ee20-49a1-8251-449342c9d024 service nova] Enqueued Resource ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 with Priority: HIGHEST for action port [ 1206.153466] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_rules [ 1206.153613] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1206.153749] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 with Priority: HIGHEST for action port [ 1206.154026] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.154188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.154251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.154459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.154540] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.155462] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.155577] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.155666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.155871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.156031] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.156132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.156193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.156380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.156479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.156575] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.159228] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.159228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.159376] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.159448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.159514] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec8ce1f-1b7f-4a25-8726-c2ede2b93902',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.660896] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.662019] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.662136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.662497] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 with status ACTIVE [ 1206.662669] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.662785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.662873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.663108] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.663200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.663383] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.663492] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.663638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.663685] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.663887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.663946] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.664040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.664085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.664257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.664345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.664434] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ec8ce1f-1b7f-4a25-8726-c2ede2b93902 is going to be updated. [ 1206.686891] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.687088] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.687179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.687383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.687526] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.687769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ec8ce1f-1b7f-4a25-8726-c2ede2b93902" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.163194] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.667998] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.667998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.667998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.667998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.667998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.667998] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1207.694583] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.694807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.694897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.695209] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.695386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.712361] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1209.725131] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1209.725450] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.725515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.725739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.725931] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.726064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.726136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.726285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.726363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.726447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.726535] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.230110] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.230308] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.230348] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.230659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.230873] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.230988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.231071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.231242] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.231367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.231431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.231575] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.231686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.232081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.232081] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.232081] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.232268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.232268] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.232325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.232354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.232438] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.232528] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.735690] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e855adc-3508-49b6-b8b1-1007e65b954b: rpc.has_security_group_logging(os_id): False [ 1210.754237] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.754384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.754480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.754683] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.754784] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.755048] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.755155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.755234] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.755377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.755456] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.755638] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.755734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.755794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.755938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.756016] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.756197] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.756291] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.756351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.756489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.756561] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.756646] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1210.823411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.823616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.823616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.823826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.824532] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.839790] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1211.154397] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.154512] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1212.858733] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1212.859119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.155781] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.155781] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1221.157384] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.157756] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1222.806457] env[65381]: INFO networking_nsxv3.common.synchronization [req-264f738e-cf2c-4b60-a36b-91114e2a0cd2 req-9c1c72f4-7a05-4673-8035-d92d7c43deb0 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1222.807083] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1222.807390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.807531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.807616] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.807787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.807939] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.808172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.808252] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.808408] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.808570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.808640] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.311621] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.814129] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.316983] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.317195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.317265] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.317484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.317643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.317766] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be updated. [ 1224.353733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.353973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.353973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.354074] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.354217] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.364958] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: IN_PROGRESS for 2s [ 1225.619864] env[65381]: INFO networking_nsxv3.common.synchronization [None req-5a9bbe80-8ca0-4f9b-8318-afb65feaf170 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_rules [ 1225.620271] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_rules [ 1225.620472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.620598] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.620663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.620942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.621048] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.697026] env[65381]: INFO networking_nsxv3.common.synchronization [None req-1f3ed501-2c4e-4a42-b6a1-122c588c17f7 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_rules [ 1225.697458] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_rules [ 1225.697782] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.697933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.143290] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.143489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.143489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.143666] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.143755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.143850] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 already deleted. [ 1226.143934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.144115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.144282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.144365] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.375448] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1226.375667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.664842] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.665170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.665170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.665292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.665356] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.665453] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 already deleted. [ 1226.665535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.767869] env[65381]: INFO networking_nsxv3.common.synchronization [req-b9028ee3-d7ce-48f8-8867-75cef694e626 req-8f367984-48b4-416e-9d39-9afe5eeb1509 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1226.768434] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1226.768756] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.768880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.768948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.769550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.769550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.769550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.769550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.769765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.769765] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.769765] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.272170] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.774479] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.276803] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.277043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.277131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.277359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.277465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.277564] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 1228.305390] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.305595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.305660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.305876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.306073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.315353] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 1229.199986] env[65381]: INFO networking_nsxv3.common.synchronization [req-293494c3-086f-4178-940b-adee70e13d21 req-d406c7bc-37a5-4a30-8e80-20a00dea24a3 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1229.199986] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGHEST for action security_group_members [ 1229.199986] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.199986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.199986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.200372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.200372] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.200372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.200467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.200594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.200679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.200773] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.704188] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.704188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.704188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.704188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.704188] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.704188] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.704460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.704460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.704460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.704554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.704837] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be updated. [ 1229.732787] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.732787] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.732985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.733145] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.733421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.742729] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: IN_PROGRESS for 2s [ 1230.326379] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 1230.326736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.269850] env[65381]: INFO networking_nsxv3.common.synchronization [req-83043593-d08f-4bc8-a0c0-8b361d2f9843 req-e9fa138d-e67b-4cbf-aa71-68a4a8a4b8f2 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_members [ 1231.270397] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_members [ 1231.270703] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.270828] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.270898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.271173] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.271327] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.271434] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.271494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.271648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.271730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.271818] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.533150] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.533150] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.533507] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.533507] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.533679] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.533830] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.533945] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.534489] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.534644] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.534901] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.535050] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1231.535164] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1231.535269] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1231.535622] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1231.535678] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1231.535800] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1231.561512] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1231.561694] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1231.561824] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1231.561994] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.562352] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.562545] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.562618] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.562969] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.563125] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fad8e7-ce59-40c4-99cb-01e3c3d1d008',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.752509] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 in Status: SUCCESS [ 1231.752693] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 deletion is rescheduled due to dependency. [ 1231.752737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.774464] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.775134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.775134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.775134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.775134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.775477] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.775477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.775477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.775650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.775705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.775817] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 already deleted. [ 1231.775866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.067367] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.067564] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.067697] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.068102] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.068145] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.068308] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 70fad8e7-ce59-40c4-99cb-01e3c3d1d008 not found, creating... [ 1232.068582] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.068757] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.068880] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.069146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.069329] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.069672] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.069837] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.069954] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.070197] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.070330] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.070478] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 70fad8e7-ce59-40c4-99cb-01e3c3d1d008 is going to be created. [ 1232.098679] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.098928] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.098989] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.099339] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.099562] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.099806] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.805088] env[65381]: INFO networking_nsxv3.common.synchronization [req-83043593-d08f-4bc8-a0c0-8b361d2f9843 req-67d29314-cd4c-47ce-a572-837332187ca0 service nova] Enqueued Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_rules [ 1232.805409] env[65381]: INFO networking_nsxv3.common.synchronization [req-83043593-d08f-4bc8-a0c0-8b361d2f9843 req-67d29314-cd4c-47ce-a572-837332187ca0 service nova] Enqueued Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_members [ 1232.805519] env[65381]: INFO networking_nsxv3.common.synchronization [req-83043593-d08f-4bc8-a0c0-8b361d2f9843 req-67d29314-cd4c-47ce-a572-837332187ca0 service nova] Enqueued Resource ID: 70fad8e7-ce59-40c4-99cb-01e3c3d1d008 with Priority: HIGHEST for action port [ 1232.806734] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_rules [ 1232.806905] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_members [ 1232.807076] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70fad8e7-ce59-40c4-99cb-01e3c3d1d008 with Priority: HIGHEST for action port [ 1232.807464] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.807622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.807769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.807982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.808097] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.810141] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.810302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.810412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.810672] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.810887] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.811041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.811133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.811331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.811942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.811942] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.812961] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.813128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.813251] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.813451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.814382] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70fad8e7-ce59-40c4-99cb-01e3c3d1d008',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.315509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.316167] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.316167] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.317022] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70fad8e7-ce59-40c4-99cb-01e3c3d1d008 with status ACTIVE [ 1233.317163] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.317280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.317357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.317588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.317684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.317899] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.318031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.318077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.318873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.318873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.318873] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.318873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.318873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.318873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.318873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.319289] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70fad8e7-ce59-40c4-99cb-01e3c3d1d008 is going to be updated. [ 1233.344398] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.344398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.344398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.344597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.344752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.345063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70fad8e7-ce59-40c4-99cb-01e3c3d1d008" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.821057] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.322801] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.323032] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.323105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.323631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.323814] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.323898] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 is going to be created. [ 1234.349339] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.349609] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.349676] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.349894] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.350226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.361929] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 in Status: UNINITIALIZED for 2s [ 1234.769244] env[65381]: INFO networking_nsxv3.common.synchronization [None req-7ef58531-1079-4eba-a180-20cdc72ef1b6 tempest-AttachInterfacesTestJSON-684323108 tempest-AttachInterfacesTestJSON-684323108-project-member] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1234.769244] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGHEST for action security_group_members [ 1234.769928] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.770302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.770557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.770869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.771139] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.771375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.771650] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.772857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.772857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.772857] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.274866] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.275206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.275206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.275501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.275628] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.275863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.275991] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.276104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.276316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.276423] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.276534] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be updated. [ 1235.313645] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.313866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.313866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.314212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.314490] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.326098] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: IN_PROGRESS for 2s [ 1236.373087] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 in Status: SUCCESS [ 1236.373363] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.373496] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.373709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.373925] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.374057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.374137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.374312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.374396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.374482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.374581] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.876612] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.338127] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e855adc-3508-49b6-b8b1-1007e65b954b in Status: SUCCESS [ 1237.338340] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b deletion is rescheduled due to dependency. [ 1237.338455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.379042] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 61a8d8d2-1375-43b1-aae0-05de36851bc2: rpc.has_security_group_logging(os_id): False [ 1237.398505] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.398738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.398790] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.398981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.399092] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.399391] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.399514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.399592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.400043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.400043] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.400043] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 is going to be created. [ 1237.459884] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.460117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.460117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.460316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.460499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.473064] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 in Status: IN_PROGRESS for 2s [ 1237.892019] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.892019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.892019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.892019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.892019] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.892019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.892019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.892019] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.892605] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.892937] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.893210] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.893464] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.893738] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.893998] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.894256] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.894534] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.916044] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.916613] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1237.918053] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.918053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-500" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.918053] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-217522fd-a0c3-4573-be1f-f921ccfa5ed2 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.918053] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.918439] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.918835] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.919133] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217522fd-a0c3-4573-be1f-f921ccfa5ed2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.423114] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.423114] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.423114] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.423614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.423614] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.423846] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.424095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.424288] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.424628] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.424852] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.425281] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.425445] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.425566] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.425821] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.426034] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.426230] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 is going to be updated. [ 1238.449100] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.449362] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.449439] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.449757] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.449998] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.450360] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.184371] env[65381]: INFO networking_nsxv3.common.synchronization [req-2165c4ed-537a-4209-a5e4-59dc3f2c8977 req-01c8b2c6-7fc1-4509-90e7-e6a28f1b647d service nova] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_rules [ 1239.184631] env[65381]: INFO networking_nsxv3.common.synchronization [req-2165c4ed-537a-4209-a5e4-59dc3f2c8977 req-01c8b2c6-7fc1-4509-90e7-e6a28f1b647d service nova] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1239.184783] env[65381]: INFO networking_nsxv3.common.synchronization [req-2165c4ed-537a-4209-a5e4-59dc3f2c8977 req-01c8b2c6-7fc1-4509-90e7-e6a28f1b647d service nova] Enqueued Resource ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 with Priority: HIGHEST for action port [ 1239.185467] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_rules [ 1239.185582] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1239.185653] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 with Priority: HIGHEST for action port [ 1239.185947] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.186087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.186158] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.186357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.186436] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.187902] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.187902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.187902] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.188099] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.188142] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.188301] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.188364] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.189028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.189028] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.189028] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.189684] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-217522fd-a0c3-4573-be1f-f921ccfa5ed2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.189863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.189952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.190152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.190251] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('217522fd-a0c3-4573-be1f-f921ccfa5ed2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.484513] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 in Status: SUCCESS [ 1239.484871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.693069] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.693069] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.693069] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.693991] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 217522fd-a0c3-4573-be1f-f921ccfa5ed2 with status ACTIVE [ 1239.694192] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.694315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.694384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.694595] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.694686] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.694919] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.695019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.695019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.695179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.695256] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.695435] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.695528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.695586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.695723] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.695795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.695878] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 217522fd-a0c3-4573-be1f-f921ccfa5ed2 is going to be updated. [ 1239.718992] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.719193] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.719238] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.720052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.720052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.720052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-217522fd-a0c3-4573-be1f-f921ccfa5ed2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.198527] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.701459] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.701459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.701459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.701459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.701459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.701459] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1240.736445] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.736445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.736445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.736445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.736445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.746784] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1242.757925] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1242.758340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.758506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.758766] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.759016] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.759195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.759309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.759517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.759643] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.759780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.759921] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.263025] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.263276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.263276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.263480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.263849] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.263977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.264058] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.264236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.264404] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.264448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.264586] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.264681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.264743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.264912] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.265157] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.265303] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.265369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.265508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.265605] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.265694] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.265814] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.768317] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9effaefa-64b1-432a-88af-119a7ba350ad: rpc.has_security_group_logging(os_id): False [ 1243.794499] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.794746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.794746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.794888] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.794974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.795263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.795366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.795421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.795583] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.795659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.795837] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.795936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.796037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.796246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.796313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.796497] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.796593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.796911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.796911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.796911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.797055] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1243.897349] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.898136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.898136] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.898280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.898317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.969841] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1244.186729] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.186912] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1245.660337] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1245.660835] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1245.987655] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1245.988079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.062074] env[65381]: INFO networking_nsxv3.common.synchronization [req-12aaaa53-55e3-4051-aaf2-94d06a5be83d req-0abbc22f-1917-41cb-960f-3f4479577521 tempest-ServerActionsTestOtherA-638214086 tempest-ServerActionsTestOtherA-638214086-project-member] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1246.062764] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGHEST for action security_group_members [ 1246.063334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.063398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.063473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.063734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.063965] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.064141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.064271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.064572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.064572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.064700] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.570326] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.570572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.570572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.570770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.570860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.571065] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.571190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.571292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.571503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.571593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.571684] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be updated. [ 1246.603221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.603445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.603445] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.603623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.603768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.612660] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: IN_PROGRESS for 2s [ 1247.401148] env[65381]: INFO networking_nsxv3.common.synchronization [req-60dda7c8-2e8a-4b09-8a78-5df1438f0678 req-26a05ae9-ec3f-4285-ba6b-40bf77fe7269 tempest-ServerActionsTestJSON-63546143 tempest-ServerActionsTestJSON-63546143-project-member] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1247.401764] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGHEST for action security_group_members [ 1247.402093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.402233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.402281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.402554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.402640] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.402740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.402791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.402943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.403373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.403373] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.906070] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.906319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.906319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.906620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.906725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.906936] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.907051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.907384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.907384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.907384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.907507] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be updated. [ 1247.943221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.943422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.943465] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.943733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.943969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.962521] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: IN_PROGRESS for 2s [ 1248.626578] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9694af19-2e42-4299-8799-3ccc40da653d in Status: SUCCESS [ 1248.626972] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9694af19-2e42-4299-8799-3ccc40da653d deletion is rescheduled due to dependency. [ 1248.626972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.973101] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 in Status: SUCCESS [ 1249.973469] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 deletion is rescheduled due to dependency. [ 1249.973469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.402666] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.403036] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1256.736844] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-966 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.737220] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.737220] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.737523] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.737781] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.737941] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.738078] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.738306] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.738466] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.738676] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.738786] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.738894] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.738997] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.739116] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.739216] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.739347] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.760381] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.760646] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1256.760755] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.760922] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-966" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.761253] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-fcb330fe-f745-42c6-8d04-21d333a080cf taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.761431] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.761548] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.761949] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.762109] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb330fe-f745-42c6-8d04-21d333a080cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.264279] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.264572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.264668] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.264952] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.265124] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.265477] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.265700] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.265828] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.266066] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.266205] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.266486] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.266667] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.266793] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.267011] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.267166] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.267334] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: fcb330fe-f745-42c6-8d04-21d333a080cf is going to be updated. [ 1257.288897] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.289146] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.289227] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.289496] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.289689] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.289917] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.403972] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.404187] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.985382] env[65381]: INFO networking_nsxv3.common.synchronization [req-aa7c02a5-6d76-445a-9be3-0cf52d5afec4 req-7bd13eaa-2201-40b0-97d1-baac5290c2ad service nova] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1257.985667] env[65381]: INFO networking_nsxv3.common.synchronization [req-aa7c02a5-6d76-445a-9be3-0cf52d5afec4 req-7bd13eaa-2201-40b0-97d1-baac5290c2ad service nova] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1257.985967] env[65381]: INFO networking_nsxv3.common.synchronization [req-aa7c02a5-6d76-445a-9be3-0cf52d5afec4 req-7bd13eaa-2201-40b0-97d1-baac5290c2ad service nova] Enqueued Resource ID: fcb330fe-f745-42c6-8d04-21d333a080cf with Priority: HIGHEST for action port [ 1257.986750] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_rules [ 1257.990112] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1257.990112] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcb330fe-f745-42c6-8d04-21d333a080cf with Priority: HIGHEST for action port [ 1257.990112] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.990112] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.990389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.990389] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.990464] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.991308] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.991418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.991482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.991652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.991792] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.991882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.991942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.992091] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.992267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.992267] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.993373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcb330fe-f745-42c6-8d04-21d333a080cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.993477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.993534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.993684] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.993755] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcb330fe-f745-42c6-8d04-21d333a080cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.325301] env[65381]: INFO networking_nsxv3.common.synchronization [None req-651eb0e5-4a9e-45aa-9bf8-664c37b1b7e1 None None] Enqueued Resource ID: 7c11433b-4ded-4395-9985-2befd192104f with Priority: HIGHEST for action port [ 1258.325594] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c11433b-4ded-4395-9985-2befd192104f with Priority: HIGHEST for action port [ 1258.326176] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c11433b-4ded-4395-9985-2befd192104f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.326316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c11433b-4ded-4395-9985-2befd192104f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.326414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c11433b-4ded-4395-9985-2befd192104f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.326682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c11433b-4ded-4395-9985-2befd192104f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.326773] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c11433b-4ded-4395-9985-2befd192104f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.497981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.497981] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.497981] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcb330fe-f745-42c6-8d04-21d333a080cf with status ACTIVE [ 1258.497981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.497981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.497981] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.499045] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.499652] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.499839] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.500095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.500278] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.500455] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcb330fe-f745-42c6-8d04-21d333a080cf is going to be updated. [ 1258.525199] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.525199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.525199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.525484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.525484] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.525742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcb330fe-f745-42c6-8d04-21d333a080cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.828960] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c11433b-4ded-4395-9985-2befd192104f [ 1258.829221] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.829362] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.829433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.829654] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.829742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.829841] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c11433b-4ded-4395-9985-2befd192104f already deleted. [ 1258.829926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c11433b-4ded-4395-9985-2befd192104f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.957058] env[65381]: INFO networking_nsxv3.common.synchronization [None req-a755b280-364b-405f-9861-38025e4973b8 tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1258.957659] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1258.957914] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.958052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.958117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.958495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.958580] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.002715] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.051944] env[65381]: INFO networking_nsxv3.common.synchronization [None req-66dcbd06-9956-4308-ac81-b8c35fe28c0e tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1259.052514] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1259.052887] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.052995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.505229] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.505373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.505421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.505726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.505825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.505901] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be updated. [ 1259.516210] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.516361] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.516418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.516623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.516711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.516866] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb already deleted. [ 1259.516917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.517046] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.517200] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.517284] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.542966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.543118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.543190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.543403] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.543549] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.553463] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: IN_PROGRESS for 2s [ 1260.038466] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.039592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.039592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.039592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.039592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.039592] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb already deleted. [ 1260.039592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.572153] env[65381]: INFO networking_nsxv3.common.synchronization [None req-86c91087-1be4-4770-9704-1fde2962b89d None None] Enqueued Resource ID: 74647d01-7ee6-4766-92d6-4ec9da239b85 with Priority: HIGHEST for action port [ 1260.572506] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74647d01-7ee6-4766-92d6-4ec9da239b85 with Priority: HIGHEST for action port [ 1260.572924] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-74647d01-7ee6-4766-92d6-4ec9da239b85 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.573059] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74647d01-7ee6-4766-92d6-4ec9da239b85" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.573129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74647d01-7ee6-4766-92d6-4ec9da239b85" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.573386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74647d01-7ee6-4766-92d6-4ec9da239b85" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.573471] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74647d01-7ee6-4766-92d6-4ec9da239b85',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.075641] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74647d01-7ee6-4766-92d6-4ec9da239b85 [ 1261.076073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.076192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.076309] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.076588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.076719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.076853] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74647d01-7ee6-4766-92d6-4ec9da239b85 already deleted. [ 1261.076959] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74647d01-7ee6-4766-92d6-4ec9da239b85" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.564700] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: SUCCESS [ 1261.564935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.565177] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.565488] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.565710] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.565841] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.565904] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.566107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.566197] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.566290] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.566388] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.069284] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.572504] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b920740-c3e2-4b99-9809-c5e2dc5ba69f: rpc.has_security_group_logging(os_id): False [ 1262.591239] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.591629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.591629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.591629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.591749] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.591988] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.592152] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.592213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.592410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.592508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.592603] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be updated. [ 1262.713349] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.713349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.713349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.713349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.713349] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.713349] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: IN_PROGRESS for 2s [ 1264.634054] env[65381]: INFO networking_nsxv3.common.synchronization [req-688ce7fc-502f-4356-89c1-4cf6741a1de0 req-0b930138-b385-4fed-aac1-38fbfb80b4df tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1264.635160] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1264.635160] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.635323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.635417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.636151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.636151] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.636151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.636151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.636411] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.636564] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.636673] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.684185] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: SUCCESS [ 1264.684417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.969592] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-164 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.969592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.969818] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.970492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.970492] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.970492] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.970718] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.970817] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.970933] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.971158] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1264.971546] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1264.971546] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1264.971546] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1264.971679] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1264.971788] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1264.971850] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1264.996070] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1264.996283] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1264.996512] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1264.996764] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.997221] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.997584] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.997775] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.998229] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.998437] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.139780] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.140021] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.140098] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.140386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.140508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.140772] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.140906] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.140995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.141232] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.141421] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.141508] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb already deleted. [ 1265.141557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.500851] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.501278] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.501517] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.501904] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.502081] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.502250] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe not found, creating... [ 1265.502538] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.502741] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.502864] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.503177] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.503342] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.503749] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.503940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.504073] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.504292] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.504427] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.504584] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe is going to be created. [ 1265.527146] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.527335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.527520] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.527805] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.528055] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.528306] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.235987] env[65381]: INFO networking_nsxv3.common.synchronization [req-688ce7fc-502f-4356-89c1-4cf6741a1de0 req-1be9ca29-630c-42c5-a998-e0ad15374be0 service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1266.236497] env[65381]: INFO networking_nsxv3.common.synchronization [req-688ce7fc-502f-4356-89c1-4cf6741a1de0 req-1be9ca29-630c-42c5-a998-e0ad15374be0 service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1266.236497] env[65381]: INFO networking_nsxv3.common.synchronization [req-688ce7fc-502f-4356-89c1-4cf6741a1de0 req-1be9ca29-630c-42c5-a998-e0ad15374be0 service nova] Enqueued Resource ID: bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe with Priority: HIGHEST for action port [ 1266.236908] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1266.236908] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1266.237073] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe with Priority: HIGHEST for action port [ 1266.237283] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.237477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.237545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.237760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.237842] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.238702] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.238823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.238891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.239194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.239313] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.239313] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.239394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.239505] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.239679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.239802] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.240603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.240700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.240737] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.240876] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.240952] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.742944] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.743247] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.743364] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe with status ACTIVE [ 1266.743563] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.743677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.743730] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.744030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.744120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.744307] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.744530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.744530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.744741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.744741] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.744963] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.745100] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.745164] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.745339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.745437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.745563] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe is going to be updated. [ 1266.747068] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.769848] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.770113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.770113] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.770275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.770412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.770580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc7f1889-fdd4-4d4f-9b71-e55eaf9ecafe" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.249282] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.752331] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.752597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.752597] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.752867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.752962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.753084] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be created. [ 1267.787570] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.787809] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.787856] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.788065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.788231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.802130] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: UNINITIALIZED for 2s [ 1269.813501] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1269.813934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.813934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.814159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.814352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.814494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.814563] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.814756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.814829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.814918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.815022] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.317187] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.820497] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb: rpc.has_security_group_logging(os_id): False [ 1270.837809] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.837989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.837989] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.838213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.838316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.838540] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.838634] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.838698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.838849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.838928] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.839028] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be created. [ 1270.894350] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.894510] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.894575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.894789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.894967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.905763] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1271.039068] env[65381]: INFO networking_nsxv3.common.synchronization [req-c4e29c32-23a0-4406-8880-f62a8ce4dc3e req-89aade21-6591-4ff0-acc2-84e35e30c962 tempest-ServersNegativeTestJSON-1064847459 tempest-ServersNegativeTestJSON-1064847459-project-member] Enqueued Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1271.039545] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9effaefa-64b1-432a-88af-119a7ba350ad with Priority: HIGHEST for action security_group_members [ 1271.039842] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9effaefa-64b1-432a-88af-119a7ba350ad taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.039965] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.040280] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.040373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.040595] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.040719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.040785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.040942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.041038] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.041132] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9effaefa-64b1-432a-88af-119a7ba350ad',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.543986] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.544257] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.544375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.544687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.544843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.545170] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.545401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.545475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.545705] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.545837] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.545979] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad is going to be updated. [ 1271.577371] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.577618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.577618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.577823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.577973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.590337] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: IN_PROGRESS for 2s [ 1272.917422] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1272.917797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.600265] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9effaefa-64b1-432a-88af-119a7ba350ad in Status: SUCCESS [ 1273.600457] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9effaefa-64b1-432a-88af-119a7ba350ad deletion is rescheduled due to dependency. [ 1273.600503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9effaefa-64b1-432a-88af-119a7ba350ad" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.041101] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.041480] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.783957] env[65381]: INFO networking_nsxv3.common.synchronization [req-59dd4540-250f-4a0b-8834-9ba5abca4569 req-c863c564-cbc2-41a1-b47e-471d6694f423 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_members [ 1280.784590] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 with Priority: HIGHEST for action security_group_members [ 1280.784950] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-61a8d8d2-1375-43b1-aae0-05de36851bc2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.785105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.785185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.785375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.785621] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.785729] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.785793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.785944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.786044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.786134] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('61a8d8d2-1375-43b1-aae0-05de36851bc2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.288614] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.288885] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.289077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.289358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.289513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.289771] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.289905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.289993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.290189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.290272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.290364] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 is going to be updated. [ 1281.319526] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.319734] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.319775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.320094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.320284] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.328719] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 in Status: IN_PROGRESS for 2s [ 1283.339623] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 in Status: SUCCESS [ 1283.339998] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 61a8d8d2-1375-43b1-aae0-05de36851bc2 deletion is rescheduled due to dependency. [ 1283.339998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-61a8d8d2-1375-43b1-aae0-05de36851bc2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.785360] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.785794] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.787197] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.787617] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.270264] env[65381]: INFO networking_nsxv3.common.synchronization [req-5a1a81e5-af15-4a68-bbd8-0e94abf35c15 req-f5cb389b-eac9-4d75-945a-0a190218304e tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_members [ 1292.270826] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGHEST for action security_group_members [ 1292.271145] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.271271] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.271339] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.271535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.271707] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.271813] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.271875] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.272045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.272131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.272226] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.774569] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.774799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.774799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.775051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.775150] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.775353] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.775453] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.775515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.775739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.775819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.775907] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb442c62-d788-4f5d-a473-ba31d928824c is going to be updated. [ 1292.802036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.802261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.802261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.802407] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.802544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.811095] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb442c62-d788-4f5d-a473-ba31d928824c in Status: IN_PROGRESS for 2s [ 1294.821632] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb442c62-d788-4f5d-a473-ba31d928824c in Status: SUCCESS [ 1294.822045] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb442c62-d788-4f5d-a473-ba31d928824c deletion is rescheduled due to dependency. [ 1294.822045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.821788] env[65381]: INFO networking_nsxv3.common.synchronization [None req-c6a5b738-bf2a-4454-94a7-b0a0233fd03f tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_rules [ 1296.822245] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_rules [ 1296.822515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.822515] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.822644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.822791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.822873] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.900730] env[65381]: INFO networking_nsxv3.common.synchronization [None req-6c4c3e2b-e38b-420a-a575-bef430b3af19 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_rules [ 1296.901546] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_rules [ 1296.901851] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.901955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.343170] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.343388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.343388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.343594] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.343681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.343774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c already deleted. [ 1297.343860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.344014] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.344168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.344249] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.864965] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.865366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.865366] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.865463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.865506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.865688] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c already deleted. [ 1297.865688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.902907] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.902907] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.247662] env[65381]: INFO networking_nsxv3.common.synchronization [req-1dfa00b9-fe90-422f-b102-84dcf6bde192 req-3e1aa855-2d77-47a2-b012-f39ee90a81ff tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_members [ 1302.248254] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_members [ 1302.248567] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.248689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.248776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.249073] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.249270] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.249351] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.249401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.249559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.249644] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.249736] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.504625] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.504828] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.504894] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.505148] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.505408] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.505564] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.505681] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.505908] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.506066] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.506276] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1302.506387] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.506493] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.506597] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.506707] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1302.506810] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.506936] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.530110] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.530296] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1302.530388] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.530560] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.530872] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.531068] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.531192] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.531511] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.531661] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f6ea1c-ef1f-44c0-8a98-bed1e182aa33',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.751972] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.752218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.752218] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.752382] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.752467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.752660] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.752758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.752819] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.752964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.753050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.753136] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c already deleted. [ 1302.753216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.034068] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.034500] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.034500] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.034738] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.034915] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.035116] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 not found, creating... [ 1303.035408] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.035589] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.035730] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.036030] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.036181] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.036499] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.036655] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.036788] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.037027] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.037167] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.037338] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 is going to be created. [ 1303.056871] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.057095] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.057222] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.057481] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.057709] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.057967] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.616310] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.616537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.616537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.616738] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.616883] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.724617] env[65381]: INFO networking_nsxv3.common.synchronization [req-1dfa00b9-fe90-422f-b102-84dcf6bde192 req-2e6d0862-4d46-4d83-a8ec-6ad9b9dee969 service nova] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_rules [ 1303.724785] env[65381]: INFO networking_nsxv3.common.synchronization [req-1dfa00b9-fe90-422f-b102-84dcf6bde192 req-2e6d0862-4d46-4d83-a8ec-6ad9b9dee969 service nova] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_members [ 1303.724940] env[65381]: INFO networking_nsxv3.common.synchronization [req-1dfa00b9-fe90-422f-b102-84dcf6bde192 req-2e6d0862-4d46-4d83-a8ec-6ad9b9dee969 service nova] Enqueued Resource ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 with Priority: HIGHEST for action port [ 1303.725692] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_rules [ 1303.725692] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_members [ 1303.725692] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 with Priority: HIGHEST for action port [ 1303.726073] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.726160] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.726222] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.726542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.726542] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.727319] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.727443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.727587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.727665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.727821] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.727910] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.727964] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.728131] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.728216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.728286] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.729085] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.729223] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.729300] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.729398] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.729504] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f6ea1c-ef1f-44c0-8a98-bed1e182aa33',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.119487] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.230977] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.231944] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.232067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.232248] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 with status ACTIVE [ 1304.232411] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.232520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.232584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.232781] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.232868] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.233052] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.233154] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.233216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.233368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.233447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.233626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.233716] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.233778] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.233913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.233988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.234084] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 is going to be updated. [ 1304.256989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.257231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.257231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.257397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.257533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.257687] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.622164] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.736023] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.124524] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1305.124779] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1305.238633] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.238799] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.238882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.239187] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.239282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.239390] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c is going to be created. [ 1305.265438] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.265651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.265714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.265881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.266064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.281184] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c in Status: UNINITIALIZED for 2s [ 1305.947460] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.947735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.947735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.947908] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.959457] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1305.960307] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.961431] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1305.999684] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.999898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.999898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.000102] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.010168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.010818] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 1306.010895] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'50f6ea1c-ef1f-44c0-8a98-bed1e182aa33'} {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.010980] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1306.050040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.050315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.050315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.050437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.051759] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.051937] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1306.122759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.123034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.123034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.123195] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.123523] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.123813] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1306.194828] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.195236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.195236] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.195713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.195713] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.195855] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1306.195946] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'6e855adc-3508-49b6-b8b1-1007e65b954b', 'c9c03ef0-b5e2-4757-9488-6558cc6e9841', '7660b898-6ec7-4760-b27c-7cb825cac126', '9694af19-2e42-4299-8799-3ccc40da653d', 'bbd14683-7670-4a2a-a1cd-5d0d61d11e46', '34a23f96-505a-4b63-87f3-5175bacc51ab', 'b833f6e1-94c4-4ead-8d63-74d29b12d7a2', '915a6b47-7bba-4851-9dc7-06e0692a5259', '6b920740-c3e2-4b99-9809-c5e2dc5ba69f', 'c0309f4f-d87e-4e36-bcfb-dc749a00a108', '6ea7ac34-a800-4898-bb50-0dd416be04d0', '784f4514-1cec-43fd-97c8-9a7ad1576b94', '589d1cd6-9e5a-4c7a-91aa-0a588632eb00', '2380b72e-771a-447f-bf96-4a7738880121', 'c007b86e-f555-43b0-9e5a-60b1b4faffb3', '6413c0f9-b937-44ab-ae61-b7613757b3e9', '993d6955-5d35-45d8-9907-eba6ec8a9076', '8b58c566-5d76-43c3-8ec7-fbe48a220f7a', 'fb442c62-d788-4f5d-a473-ba31d928824c', '2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b', '2fa502cc-eee4-43e5-bf7a-e5551fb38a40', 'd5417c42-09b8-4d6e-a6e5-4941c3e00ca9', '40be60f5-b915-4038-8a92-b31ab9bbba3e', '39a58ced-f936-4d85-96d1-2772060a7aae', '0e6956fc-e986-4223-b0b3-c4fabc7eb8cf', '0109d178-d310-4d94-9ce8-74560a55bfa3', '46372329-aee9-4feb-9469-adefbb727cb5', 'c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb', '51eca9de-71e7-42ac-8af4-13f26cb274bd', '274f904b-e458-4b4b-9611-3ae0669bc24b', '5e5ab19d-0519-49e0-95a2-457ebf3b46a0', '61c2d48d-c321-4e23-999d-809958401c70', 'b495a081-8211-4db6-af3d-10fc0b2f521c', '007dd7b5-b0ce-46da-9cc3-86f074d0bbdb', 'a5deaafa-85eb-41da-90a6-8945218fb5f5', '48eacb50-df32-446c-947a-a00fbf576caa', '2f08ea40-f56b-4bd5-a0f9-e991cad65528', 'd13ab4e4-01d1-4513-ab86-141d5851283d', 'cb494464-5516-45a4-9361-f2c93b57fef6', '6b334e63-c2b8-4d02-9110-c8fc60d33c13', 'bb17e366-3b38-46cd-836a-5d640fa33c5a', '61a8d8d2-1375-43b1-aae0-05de36851bc2', '6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61', '5819134c-7e49-4e7e-b983-fb61c5b540ad', '9effaefa-64b1-432a-88af-119a7ba350ad', 'e39161d0-dcb4-484d-ae0c-3dc95815f63d'} {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.196095] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1306.214524] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.214688] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.214748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.214962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.215061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.215167] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1306.215627] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.215627] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1306.300782] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.300960] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.301033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.301227] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.302987] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.302987] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1306.302987] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.303214] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1306.303214] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 1306.303275] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 with Priority: HIGH for action port [ 1306.303427] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/46 resources of Type:Security Group Rules [ 1306.303553] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGH for action security_group_rules [ 1306.303683] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGH for action security_group_rules [ 1306.303812] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGH for action security_group_rules [ 1306.303934] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGH for action security_group_rules [ 1306.304091] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGH for action security_group_rules [ 1306.304195] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGH for action security_group_rules [ 1306.304273] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGH for action security_group_rules [ 1306.304338] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGH for action security_group_rules [ 1306.304406] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGH for action security_group_rules [ 1306.304466] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGH for action security_group_rules [ 1306.304524] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGH for action security_group_rules [ 1306.304585] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGH for action security_group_rules [ 1306.304640] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGH for action security_group_rules [ 1306.304703] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGH for action security_group_rules [ 1306.304756] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGH for action security_group_rules [ 1306.304817] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGH for action security_group_rules [ 1306.304875] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGH for action security_group_rules [ 1306.304941] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGH for action security_group_rules [ 1306.304998] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGH for action security_group_rules [ 1306.305397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.290472] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c in Status: SUCCESS [ 1307.290859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.290859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.291111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.291306] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.291422] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.291486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.291638] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.291719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.291807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.291895] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.795069] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.296877] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9dd8321a-02cb-4cdb-814d-b0c5058cc03c: rpc.has_security_group_logging(os_id): False [ 1308.314896] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.315151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.315151] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.315359] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.315451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.315779] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.315922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.315993] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.316171] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.316253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.316355] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c is going to be created. [ 1308.372691] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.372911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.372911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.373137] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.373324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.384780] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c in Status: IN_PROGRESS for 2s [ 1308.726457] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.726681] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1308.726767] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 with Priority: HIGH for action port [ 1308.726831] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 with Priority: HIGH for action security_group_rules [ 1308.726960] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a23f96-505a-4b63-87f3-5175bacc51ab with Priority: HIGH for action security_group_rules [ 1308.727102] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2380b72e-771a-447f-bf96-4a7738880121 with Priority: HIGH for action security_group_rules [ 1308.727184] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb442c62-d788-4f5d-a473-ba31d928824c with Priority: HIGH for action security_group_rules [ 1308.727273] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a with Priority: HIGH for action security_group_rules [ 1308.727381] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 with Priority: HIGH for action security_group_rules [ 1308.727478] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 with Priority: HIGH for action security_group_rules [ 1308.727575] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 with Priority: HIGH for action security_group_rules [ 1308.727658] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 with Priority: HIGH for action security_group_rules [ 1308.727749] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 with Priority: HIGH for action security_group_rules [ 1308.727864] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 with Priority: HIGH for action security_group_rules [ 1308.727986] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 with Priority: HIGH for action security_group_rules [ 1308.728103] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGH for action security_group_rules [ 1308.728185] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 with Priority: HIGH for action security_group_rules [ 1308.728293] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 with Priority: HIGH for action security_group_rules [ 1308.728384] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 with Priority: HIGH for action security_group_rules [ 1308.728470] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9694af19-2e42-4299-8799-3ccc40da653d with Priority: HIGH for action security_group_rules [ 1308.728584] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e855adc-3508-49b6-b8b1-1007e65b954b with Priority: HIGH for action security_group_rules [ 1308.728793] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7660b898-6ec7-4760-b27c-7cb825cac126 with Priority: HIGH for action security_group_rules [ 1308.729177] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.729400] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.729513] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.729746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.729832] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f6ea1c-ef1f-44c0-8a98-bed1e182aa33',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.730927] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.731071] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.731168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.731829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.731955] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9c03ef0-b5e2-4757-9488-6558cc6e9841',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.733077] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a23f96-505a-4b63-87f3-5175bacc51ab taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.733202] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.733260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.734574] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.734574] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a23f96-505a-4b63-87f3-5175bacc51ab',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.734842] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2380b72e-771a-447f-bf96-4a7738880121 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.734948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.735041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.735269] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.735269] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2380b72e-771a-447f-bf96-4a7738880121',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.736140] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb442c62-d788-4f5d-a473-ba31d928824c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.736253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.736253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.736923] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.736923] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb442c62-d788-4f5d-a473-ba31d928824c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.737580] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.737702] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.737768] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.737942] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.738031] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b58c566-5d76-43c3-8ec7-fbe48a220f7a',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.739472] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993d6955-5d35-45d8-9907-eba6ec8a9076 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.739472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.739472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.739719] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.739828] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993d6955-5d35-45d8-9907-eba6ec8a9076',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.741289] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6413c0f9-b937-44ab-ae61-b7613757b3e9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.741449] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.741871] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.742321] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.742321] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6413c0f9-b937-44ab-ae61-b7613757b3e9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.744056] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.744410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.744410] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.744542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.744607] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('589d1cd6-9e5a-4c7a-91aa-0a588632eb00',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.745384] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.745537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.745622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.745866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.745983] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c007b86e-f555-43b0-9e5a-60b1b4faffb3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.747606] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784f4514-1cec-43fd-97c8-9a7ad1576b94 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.747816] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.747922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.748181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.748428] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784f4514-1cec-43fd-97c8-9a7ad1576b94',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.749891] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ea7ac34-a800-4898-bb50-0dd416be04d0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.750418] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.750619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.750826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.750957] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ea7ac34-a800-4898-bb50-0dd416be04d0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.752679] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.752850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.753133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.753212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.753337] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0309f4f-d87e-4e36-bcfb-dc749a00a108',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.754660] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.754853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.754937] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.755139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.755238] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.756834] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-915a6b47-7bba-4851-9dc7-06e0692a5259 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.756972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.757094] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.757354] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.757476] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('915a6b47-7bba-4851-9dc7-06e0692a5259',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.758733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.758879] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.758939] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.759168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.759277] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbd14683-7670-4a2a-a1cd-5d0d61d11e46',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.760281] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.760448] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.760559] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.760807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.760933] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b833f6e1-94c4-4ead-8d63-74d29b12d7a2',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.762256] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9694af19-2e42-4299-8799-3ccc40da653d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.762413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.762525] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.762661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.762767] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9694af19-2e42-4299-8799-3ccc40da653d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.763539] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e855adc-3508-49b6-b8b1-1007e65b954b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.763648] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.763750] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.763952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.764061] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e855adc-3508-49b6-b8b1-1007e65b954b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.764922] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7660b898-6ec7-4760-b27c-7cb825cac126 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.765936] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.766062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.766235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.766305] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7660b898-6ec7-4760-b27c-7cb825cac126',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.775357] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 with status ACTIVE [ 1308.775621] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.775857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.775952] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.776481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.776481] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.776603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.776659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.776712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.777172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.777172] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.777172] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.777342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.777342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.777444] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.777507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.777586] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50f6ea1c-ef1f-44c0-8a98-bed1e182aa33 is going to be updated. [ 1308.815057] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.815057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.815057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.815057] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.816849] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.817054] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.818042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.818194] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.819143] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.819276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.823509] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.823660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.823710] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.823915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.824084] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.824295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f6ea1c-ef1f-44c0-8a98-bed1e182aa33" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.843633] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.843847] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a23f96-505a-4b63-87f3-5175bacc51ab is going to be deleted. [ 1308.844874] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.845192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.877402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.877615] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9c03ef0-b5e2-4757-9488-6558cc6e9841 is going to be deleted. [ 1308.878624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.878865] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.906019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.906269] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb442c62-d788-4f5d-a473-ba31d928824c is going to be deleted. [ 1308.907995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.908350] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.936339] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.936700] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.958205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.958450] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2380b72e-771a-447f-bf96-4a7738880121 is going to be deleted. [ 1308.959762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.960107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.960273] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.960464] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a23f96-505a-4b63-87f3-5175bacc51ab" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.968082] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.968378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.968640] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.969034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.969216] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.969451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9c03ef0-b5e2-4757-9488-6558cc6e9841" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.994897] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.995120] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.995235] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.995545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.995697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.995877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb442c62-d788-4f5d-a473-ba31d928824c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.039637] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.039859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.039859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.040191] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.040335] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.040507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2380b72e-771a-447f-bf96-4a7738880121" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.257133] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.257369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.257369] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.257674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.257894] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.258037] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.258111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.258317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.258447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.258547] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.258639] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.265361] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.265531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.265588] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.265756] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.267599] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.267704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.271317] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.271472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.274117] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.274221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.275485] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.275584] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.306329] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.306786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.307508] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.307622] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.308439] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.308555] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.309373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.309473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.310226] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.310332] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.311038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.311139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.311858] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.311955] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.313724] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.313841] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993d6955-5d35-45d8-9907-eba6ec8a9076 is going to be deleted. [ 1309.315132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.315371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.332106] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.332357] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.333183] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.333296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.340104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.340236] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b58c566-5d76-43c3-8ec7-fbe48a220f7a is going to be deleted. [ 1309.341138] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.341375] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.359104] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.359262] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6413c0f9-b937-44ab-ae61-b7613757b3e9 is going to be deleted. [ 1309.360065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.360282] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.373594] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.373792] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.379522] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.379663] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ea7ac34-a800-4898-bb50-0dd416be04d0 is going to be deleted. [ 1309.380546] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.380773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.396108] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.396296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.406852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.407032] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784f4514-1cec-43fd-97c8-9a7ad1576b94 is going to be deleted. [ 1309.408243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.408494] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.421258] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.421431] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.427748] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.427895] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e855adc-3508-49b6-b8b1-1007e65b954b is going to be deleted. [ 1309.428793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.429056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.431453] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.431560] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.472893] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.473088] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 589d1cd6-9e5a-4c7a-91aa-0a588632eb00 is going to be deleted. [ 1309.474030] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.474246] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.538981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.539212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.548402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.548561] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9694af19-2e42-4299-8799-3ccc40da653d is going to be deleted. [ 1309.549461] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.549674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.562088] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.562281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.579569] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.579738] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c007b86e-f555-43b0-9e5a-60b1b4faffb3 is going to be deleted. [ 1309.580627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.580854] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.608378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.608588] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 915a6b47-7bba-4851-9dc7-06e0692a5259 is going to be deleted. [ 1309.609467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.609682] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.621715] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.621897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.635582] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.635797] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.636520] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.636640] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0309f4f-d87e-4e36-bcfb-dc749a00a108 is going to be deleted. [ 1309.637556] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.637774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.667548] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.667714] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b833f6e1-94c4-4ead-8d63-74d29b12d7a2 is going to be deleted. [ 1309.668667] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.668988] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.739274] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.739456] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbd14683-7670-4a2a-a1cd-5d0d61d11e46 is going to be deleted. [ 1309.740416] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.740635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.762445] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.774853] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.775070] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.804342] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.804491] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7660b898-6ec7-4760-b27c-7cb825cac126 is going to be deleted. [ 1309.805517] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.805746] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.805891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.806013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993d6955-5d35-45d8-9907-eba6ec8a9076" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.806480] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.806645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.806726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.806850] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b58c566-5d76-43c3-8ec7-fbe48a220f7a" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.807501] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.807699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.807801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.807966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6413c0f9-b937-44ab-ae61-b7613757b3e9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.808155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.808305] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.808383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.808500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ea7ac34-a800-4898-bb50-0dd416be04d0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.808632] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.808773] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.808862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.809007] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784f4514-1cec-43fd-97c8-9a7ad1576b94" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.809142] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.809285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.809360] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.809468] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e855adc-3508-49b6-b8b1-1007e65b954b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.809631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.809777] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.809891] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.810027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-589d1cd6-9e5a-4c7a-91aa-0a588632eb00" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.810841] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.810946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.811026] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.811179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.811258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.811377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c007b86e-f555-43b0-9e5a-60b1b4faffb3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.811498] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.811649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.811725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.811829] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9694af19-2e42-4299-8799-3ccc40da653d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.811944] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.812097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.812170] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.812272] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-915a6b47-7bba-4851-9dc7-06e0692a5259" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.856612] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.856822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.856869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.857095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.857203] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.857384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b833f6e1-94c4-4ead-8d63-74d29b12d7a2" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.858171] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.858283] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.858368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.858554] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.858649] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.858762] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0309f4f-d87e-4e36-bcfb-dc749a00a108" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.899146] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.899373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.899373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.899500] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.899590] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.899715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbd14683-7670-4a2a-a1cd-5d0d61d11e46" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.972660] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.972811] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.972883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.973199] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.973292] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.973413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7660b898-6ec7-4760-b27c-7cb825cac126" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.143925] env[65381]: INFO networking_nsxv3.common.synchronization [req-0cdc63f1-183b-4848-9a3a-f56f7bd3e89d req-4548821e-cd5b-4fb2-8f2d-438c8d1d4507 tempest-AttachVolumeShelveTestJSON-685145512 tempest-AttachVolumeShelveTestJSON-685145512-project-member] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1310.144633] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGHEST for action security_group_members [ 1310.144973] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.145344] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.145487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.145653] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.145817] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.145917] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.145973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.146134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.146254] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.146393] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.266390] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b920740-c3e2-4b99-9809-c5e2dc5ba69f: rpc.has_security_group_logging(os_id): False [ 1310.286784] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.286974] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.287096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.287373] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.310212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.310618] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.310786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.310898] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.311127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.311213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.311306] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be updated. [ 1310.369497] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.369699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.369699] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.369895] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.370077] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.383188] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: IN_PROGRESS for 2s [ 1310.393998] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c in Status: SUCCESS [ 1310.394502] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.649277] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.649508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.649508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.649843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.649967] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.650218] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.650347] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.650415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.650606] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.650710] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.650831] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be updated. [ 1310.677287] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.677508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.677508] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.677715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.677929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.686496] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: IN_PROGRESS for 2s [ 1312.396930] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: SUCCESS [ 1312.397378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.727607] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f in Status: SUCCESS [ 1312.727859] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f deletion is rescheduled due to dependency. [ 1312.727859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.146185] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.146597] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.147142] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.147520] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.148738] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.149174] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.149515] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.149861] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.150442] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.150835] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.151464] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.151950] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.152375] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.152749] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.153445] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.153785] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.154420] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.154866] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.155429] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.155877] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.713734] env[65381]: INFO networking_nsxv3.common.synchronization [req-563f65e0-35b8-45c9-8d25-de348351c26c req-3b0bfdd1-a0bc-49ab-bd20-e7bafbd0cce9 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_members [ 1364.714350] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGHEST for action security_group_members [ 1364.714747] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.714911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.715550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.715550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.715550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.715550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.715760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.715760] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.715831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.715908] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.219056] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.219056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.219056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.219056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.219056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.219367] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.219367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.219367] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.219514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.219514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.219571] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c is going to be updated. [ 1365.255601] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.255824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.255824] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.256022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.256127] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.265648] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c in Status: IN_PROGRESS for 2s [ 1367.276369] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c in Status: SUCCESS [ 1367.276742] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c deletion is rescheduled due to dependency. [ 1367.276742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.371792] env[65381]: INFO networking_nsxv3.common.synchronization [None req-efe769bb-85bb-4cb8-8353-75a9f0d1b49d tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_rules [ 1369.372263] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_rules [ 1369.372623] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.372711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.372786] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.373063] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.373144] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.452519] env[65381]: INFO networking_nsxv3.common.synchronization [None req-85d6a035-e782-4176-8692-8239e5ce6047 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_rules [ 1369.453056] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_rules [ 1369.453360] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.453462] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.894028] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.894204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.894276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.894575] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.894673] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.894774] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead already deleted. [ 1369.894877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.896041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.896041] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.896041] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.415830] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.416253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.416253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.416391] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.416512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.416588] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead already deleted. [ 1370.416670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.454394] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.454740] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.823984] env[65381]: INFO networking_nsxv3.common.synchronization [req-fc946741-6558-4578-aa54-d9a0a1085f05 req-a352a866-2371-41ad-8390-45a250a15b30 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_members [ 1374.824435] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_members [ 1374.824752] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.824873] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.824938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.825550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.825550] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.825550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.825550] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.825830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.825830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.825830] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.123518] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.123734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.123925] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.124268] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.124583] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.124776] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.124978] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.125153] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.125293] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.125503] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1375.125925] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1375.125925] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1375.125925] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1375.125925] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1375.126104] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1375.126140] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1375.151338] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1375.151525] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1375.151623] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1375.151803] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-90" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.152138] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.152308] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.152432] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.152814] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.152954] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6a2f659-02d8-4308-bc6b-38ac3f1255b6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.329093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.329323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.329323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.329580] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.329698] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.329939] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.330062] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.330128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.330293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.330371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.330456] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead already deleted. [ 1375.330539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.655180] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.655572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.655572] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.655766] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.655905] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.656080] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port e6a2f659-02d8-4308-bc6b-38ac3f1255b6 not found, creating... [ 1375.656346] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.656528] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.656647] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.656868] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.657013] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.657304] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.657462] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.657579] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.657789] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.657923] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.658082] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: e6a2f659-02d8-4308-bc6b-38ac3f1255b6 is going to be created. [ 1375.678155] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.678370] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.678458] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.678753] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.678971] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.679207] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.350192] env[65381]: INFO networking_nsxv3.common.synchronization [req-fc946741-6558-4578-aa54-d9a0a1085f05 req-57caddb1-93df-4e70-8773-42132a474514 service nova] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_rules [ 1376.350192] env[65381]: INFO networking_nsxv3.common.synchronization [req-fc946741-6558-4578-aa54-d9a0a1085f05 req-57caddb1-93df-4e70-8773-42132a474514 service nova] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_members [ 1376.350368] env[65381]: INFO networking_nsxv3.common.synchronization [req-fc946741-6558-4578-aa54-d9a0a1085f05 req-57caddb1-93df-4e70-8773-42132a474514 service nova] Enqueued Resource ID: e6a2f659-02d8-4308-bc6b-38ac3f1255b6 with Priority: HIGHEST for action port [ 1376.351241] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_rules [ 1376.351241] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_members [ 1376.351430] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6a2f659-02d8-4308-bc6b-38ac3f1255b6 with Priority: HIGHEST for action port [ 1376.351589] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.351709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.351776] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.351982] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.352078] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.353329] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.353329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.353329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.353329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.353543] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.353543] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.353624] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.353718] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.353794] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.353930] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.354644] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.354755] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.354823] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.354972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.355057] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6a2f659-02d8-4308-bc6b-38ac3f1255b6',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.857751] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.858051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.859318] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.861034] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6a2f659-02d8-4308-bc6b-38ac3f1255b6 with status ACTIVE [ 1376.861034] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.861034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.861034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.861034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.861034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.861377] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.861377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.861377] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.862040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.862040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.862040] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.862040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.862040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.862040] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.862311] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.862311] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6a2f659-02d8-4308-bc6b-38ac3f1255b6 is going to be updated. [ 1376.882583] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.882782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.882782] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.882968] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.883117] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.883275] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6a2f659-02d8-4308-bc6b-38ac3f1255b6" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.364207] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.866646] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.867082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.867082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.867082] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.867213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.867250] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead is going to be created. [ 1377.890515] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.890711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.890711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.890918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.891086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.900322] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37606f1e-5056-4e58-a1bc-c0149290eead in Status: UNINITIALIZED for 2s [ 1379.912251] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37606f1e-5056-4e58-a1bc-c0149290eead in Status: SUCCESS [ 1379.912725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.912725] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.912935] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.913093] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.913225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.913225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.913383] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.913459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.913531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.913625] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.415969] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.918967] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37606f1e-5056-4e58-a1bc-c0149290eead: rpc.has_security_group_logging(os_id): False [ 1380.936683] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.936897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.936897] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.937133] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.937226] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.937468] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.937572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.937631] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.937838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.937921] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.938018] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead is going to be created. [ 1381.004640] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.004853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.004905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.005132] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.005312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.017846] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37606f1e-5056-4e58-a1bc-c0149290eead in Status: IN_PROGRESS for 2s [ 1381.352845] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.353114] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1383.033164] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37606f1e-5056-4e58-a1bc-c0149290eead in Status: SUCCESS [ 1383.033557] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.354586] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.354586] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.356209] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.356640] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.989479] env[65381]: INFO networking_nsxv3.common.synchronization [req-68de7ddf-c5b1-496f-839b-63b05af4259f req-6fbc3984-8e35-466d-b890-eba6e14f88bd tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1392.990251] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1392.990709] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.990709] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.990838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.990954] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.991248] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.991248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.991386] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.991437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.991486] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.991587] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.495126] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.495126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.495473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.495473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.517720] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.517989] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.518135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.518180] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.518387] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.518467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.518556] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1393.545626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.545855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.545855] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.546097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.546294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.557105] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1395.568911] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1395.569325] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb deletion is rescheduled due to dependency. [ 1395.569325] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.991194] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.991602] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.920208] env[65381]: INFO networking_nsxv3.common.synchronization [req-951a5f15-7e67-4e30-9c8d-3134907e185c req-6caf3cda-1e3f-424e-9d91-d80fcf93c366 tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1399.920416] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1399.920677] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.920803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.920872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.921258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.921414] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.921530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.921599] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.921915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.921915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.921915] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.217363] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-164 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.217569] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.217698] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.217966] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.218237] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.218395] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.218511] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.218721] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.218900] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.219271] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1400.219399] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1400.219508] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1400.219623] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1400.219745] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1400.219871] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1400.220015] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1400.241724] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1400.241896] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1400.242032] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1400.242203] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.242512] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-58b1356b-8889-4497-b8ba-3ddc19ae4f14 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.242681] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.242797] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.243164] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.243299] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58b1356b-8889-4497-b8ba-3ddc19ae4f14',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.424164] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.424394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.424394] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.424576] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.424635] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.424829] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.424924] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.424977] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.425149] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.425224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.425309] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1400.451820] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.452013] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.452056] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.452230] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.452368] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.462285] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1400.746179] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.746450] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.746536] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.746848] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.746993] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.747166] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Segment Port 58b1356b-8889-4497-b8ba-3ddc19ae4f14 not found, creating... [ 1400.747421] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.747585] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.747695] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.747920] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.748068] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.748351] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.748501] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.748618] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.748858] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.748990] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.749143] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: 58b1356b-8889-4497-b8ba-3ddc19ae4f14 is going to be created. [ 1400.771278] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.771542] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.771613] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.772024] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.772302] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.772568] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.449225] env[65381]: INFO networking_nsxv3.common.synchronization [req-951a5f15-7e67-4e30-9c8d-3134907e185c req-b17b7db9-d593-42ab-8fee-1200c1b2390d service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1401.449483] env[65381]: INFO networking_nsxv3.common.synchronization [req-951a5f15-7e67-4e30-9c8d-3134907e185c req-b17b7db9-d593-42ab-8fee-1200c1b2390d service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1401.449557] env[65381]: INFO networking_nsxv3.common.synchronization [req-951a5f15-7e67-4e30-9c8d-3134907e185c req-b17b7db9-d593-42ab-8fee-1200c1b2390d service nova] Enqueued Resource ID: 58b1356b-8889-4497-b8ba-3ddc19ae4f14 with Priority: HIGHEST for action port [ 1401.450159] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1401.450296] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1401.450397] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b1356b-8889-4497-b8ba-3ddc19ae4f14 with Priority: HIGHEST for action port [ 1401.450678] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.450822] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.450861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.451072] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.451179] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.452380] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.452477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.452671] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-58b1356b-8889-4497-b8ba-3ddc19ae4f14 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.452775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.452842] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.453033] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.453112] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58b1356b-8889-4497-b8ba-3ddc19ae4f14',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.955654] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.955862] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.956070] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58b1356b-8889-4497-b8ba-3ddc19ae4f14 with status ACTIVE [ 1401.956312] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.956435] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.956537] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.956767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.956863] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.957045] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.957166] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.957206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.957365] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.957443] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.957621] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.957715] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.957826] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.957943] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.958051] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.958111] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58b1356b-8889-4497-b8ba-3ddc19ae4f14 is going to be updated. [ 1401.978733] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.978984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.978984] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.979179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.979315] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.979474] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58b1356b-8889-4497-b8ba-3ddc19ae4f14" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.472358] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1402.472706] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb deletion is rescheduled due to dependency. [ 1402.472706] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.472780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.473020] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.473205] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.473320] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.473384] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.473544] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.473623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.473717] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.976437] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.479324] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.982722] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.982957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.982957] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.983065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.983159] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.983265] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1404.010910] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.011096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.011208] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.011499] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.011659] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.020597] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1406.031562] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1406.031963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.031963] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.032134] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.032326] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.032446] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.032514] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.032670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.032752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.032838] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.032971] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.451212] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.451393] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1406.534997] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.037170] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb: rpc.has_security_group_logging(os_id): False [ 1407.055962] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.056206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.056206] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.056426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.056521] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.056808] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.056933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.057010] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.057181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.057293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.057339] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1407.131543] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.131758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.131758] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.131926] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.132087] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.151245] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1409.165687] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1409.166076] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.452282] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.452646] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.453906] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.453906] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.454924] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.455308] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.455864] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.456160] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.457125] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1431.457125] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.457781] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.458198] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.544516] env[65381]: INFO networking_nsxv3.common.synchronization [req-cbcd4e53-6ab3-4f02-94f7-f2582407a4c6 req-83e13e06-50c1-4d64-9f11-76eb2a3c17b2 tempest-AttachVolumeNegativeTest-977958736 tempest-AttachVolumeNegativeTest-977958736-project-member] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_members [ 1438.544784] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGHEST for action security_group_members [ 1438.544999] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.545665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.545665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.545665] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.545665] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.545930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.545930] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.546019] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.546053] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.546151] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.048961] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.049288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.049288] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.049487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.049581] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.049808] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.049938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.050017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.050228] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.050330] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.050421] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead is going to be updated. [ 1439.078321] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.078530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.078530] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.078692] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.078830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.088228] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37606f1e-5056-4e58-a1bc-c0149290eead in Status: IN_PROGRESS for 2s [ 1441.100614] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37606f1e-5056-4e58-a1bc-c0149290eead in Status: SUCCESS [ 1441.100614] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead deletion is rescheduled due to dependency. [ 1441.100614] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.546264] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.546663] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.547326] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.547737] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.548494] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.548833] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.550130] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.550516] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.551704] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.552154] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.552487] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.552870] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.553444] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.553849] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.555129] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.555554] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1483.556599] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.557037] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.660930] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1485.661303] env[65381]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-6b2fb306-4f87-4118-927f-0969b047baa6 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1488.558140] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.558548] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.559227] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.559592] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.310370] env[65381]: INFO networking_nsxv3.common.synchronization [req-1c6262ec-652d-44ca-be45-85b714d22cc1 req-4c0bc0a3-28f3-49ad-b742-714f0892eb1b tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1496.310942] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1496.311276] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.311420] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.311489] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.311726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.311886] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.312031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.312115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.312295] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.312612] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.312612] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1496.815233] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.815507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.815507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.815670] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.815764] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.815947] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.816055] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.816110] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.816258] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.816333] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.816418] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1496.853539] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.853785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.853785] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.854103] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.854331] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.863465] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1498.873779] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1498.874181] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb deletion is rescheduled due to dependency. [ 1498.874181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.311567] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.311987] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.312675] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.313062] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.802451] env[65381]: INFO networking_nsxv3.common.synchronization [req-2c4434f7-8e0d-4eea-bd9e-10549920cb68 req-41317e2c-5621-47d2-af73-9a09c9edcef4 tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1506.802810] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1506.803129] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.803250] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.803316] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.803512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.803659] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.803791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.803853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.804061] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.804185] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.804323] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.155639] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock network-164 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.155888] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.156027] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.156342] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.156629] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.156790] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.156934] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.157177] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.157356] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.157574] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1507.157698] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1507.157840] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1507.157959] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1507.158083] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1507.158187] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1507.158341] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1507.178885] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1507.179075] env[65381]: DEBUG dogpile.cache.region [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1507.179215] env[65381]: DEBUG dogpile.lock [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1507.179377] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.179671] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.179864] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.180015] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.180325] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.180475] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a0b75a-3e0d-4a93-baa3-13c4be0357ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.307263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.307417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.307485] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.307697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.307789] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.307980] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.308095] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.308148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.308299] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.308427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.308489] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1507.332168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.332504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.332504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.332607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.332696] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.341652] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1507.683375] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.683626] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.683681] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.683962] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.684128] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.684279] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Segment Port b7a0b75a-3e0d-4a93-baa3-13c4be0357ff not found, creating... [ 1507.684556] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.684693] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.684809] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.685052] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.685189] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.685465] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.685620] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.685734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.685940] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.686083] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.686221] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Resource: SegmentPort with ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff is going to be created. [ 1507.706990] env[65381]: DEBUG networking_nsxv3.common.locking [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.707227] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.707335] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.707592] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.707817] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.708051] env[65381]: DEBUG oslo_concurrency.lockutils [None req-1ea42344-4577-488c-be4d-b1727e3f4298 None None] Releasing lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.240294] env[65381]: INFO networking_nsxv3.common.synchronization [req-2c4434f7-8e0d-4eea-bd9e-10549920cb68 req-7bc7cb77-7a2f-45ba-9670-f41905fa2ce8 service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1509.240589] env[65381]: INFO networking_nsxv3.common.synchronization [req-2c4434f7-8e0d-4eea-bd9e-10549920cb68 req-7bc7cb77-7a2f-45ba-9670-f41905fa2ce8 service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1509.240589] env[65381]: INFO networking_nsxv3.common.synchronization [req-2c4434f7-8e0d-4eea-bd9e-10549920cb68 req-7bc7cb77-7a2f-45ba-9670-f41905fa2ce8 service nova] Enqueued Resource ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff with Priority: HIGHEST for action port [ 1509.241095] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1509.241229] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1509.241328] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff with Priority: HIGHEST for action port [ 1509.241638] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.241703] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.241767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.241961] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.242051] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.242864] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.242962] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.243743] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.243743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.243743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.243743] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.243743] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a0b75a-3e0d-4a93-baa3-13c4be0357ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.351500] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1509.351680] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb deletion is rescheduled due to dependency. [ 1509.351793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.351949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.352183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.352362] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.352475] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.352539] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.352689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.352767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.352860] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.745076] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.745298] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.745407] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7a0b75a-3e0d-4a93-baa3-13c4be0357ff with status ACTIVE [ 1509.745537] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.745645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.745711] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.745925] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.746035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.746215] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.746345] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.746433] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.746512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.746587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.746763] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.746953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.746953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.747085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.747179] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.747234] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff is going to be updated. [ 1509.767403] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.767663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.767663] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.767831] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.768022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.768126] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.854947] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.357022] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.859565] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.859853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.859853] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.860090] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.860189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.860293] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1510.891054] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.891317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.891317] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.891473] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.891618] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.900594] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1512.911794] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1512.912139] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.912201] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.912413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.912603] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.912726] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.912807] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.912998] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.913118] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.913248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.913347] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.415425] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.918349] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb: rpc.has_security_group_logging(os_id): False [ 1513.940038] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.940253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.940253] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.940402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.940506] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.940822] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.940946] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.941068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.941260] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.941353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.941440] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1514.014139] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.014402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.014402] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.014641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1514.014810] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.030435] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1514.242259] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1514.242481] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1516.047269] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1516.047660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.244394] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1519.244803] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.245849] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1524.245849] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1529.246820] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.247222] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1534.247829] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1534.248218] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1539.249478] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1539.249478] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.617101] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.617101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.617101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.617101] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.617101] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.119134] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1544.250204] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1544.250471] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1544.621396] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.124091] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1545.124359] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1545.874023] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.874483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.874483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.874483] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.886451] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1545.887397] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.888532] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1545.925961] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.926182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.926182] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.926388] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.937181] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.937943] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1545.938042] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1545.938158] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1545.972196] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.972396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.972396] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.972607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.973371] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.973532] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1546.068271] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.068487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.068487] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.068714] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.069045] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.069336] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1546.149626] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.149857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.149857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.150064] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.150417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.150701] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 1546.150790] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d5417c42-09b8-4d6e-a6e5-4941c3e00ca9', '40be60f5-b915-4038-8a92-b31ab9bbba3e', '39a58ced-f936-4d85-96d1-2772060a7aae', '0e6956fc-e986-4223-b0b3-c4fabc7eb8cf', '46372329-aee9-4feb-9469-adefbb727cb5', '0109d178-d310-4d94-9ce8-74560a55bfa3', '9dd8321a-02cb-4cdb-814d-b0c5058cc03c', '37606f1e-5056-4e58-a1bc-c0149290eead', 'c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb', '51eca9de-71e7-42ac-8af4-13f26cb274bd', '274f904b-e458-4b4b-9611-3ae0669bc24b', '5e5ab19d-0519-49e0-95a2-457ebf3b46a0', '61c2d48d-c321-4e23-999d-809958401c70', 'b495a081-8211-4db6-af3d-10fc0b2f521c', '007dd7b5-b0ce-46da-9cc3-86f074d0bbdb', '48eacb50-df32-446c-947a-a00fbf576caa', 'a5deaafa-85eb-41da-90a6-8945218fb5f5', '2f08ea40-f56b-4bd5-a0f9-e991cad65528', '6b920740-c3e2-4b99-9809-c5e2dc5ba69f', 'd13ab4e4-01d1-4513-ab86-141d5851283d', 'cb494464-5516-45a4-9361-f2c93b57fef6', '6b334e63-c2b8-4d02-9110-c8fc60d33c13', 'bb17e366-3b38-46cd-836a-5d640fa33c5a', '61a8d8d2-1375-43b1-aae0-05de36851bc2', '2fa502cc-eee4-43e5-bf7a-e5551fb38a40', '6ce2368b-dbdc-4d74-a11b-1b0eb6e2da61', '5819134c-7e49-4e7e-b983-fb61c5b540ad', '9effaefa-64b1-432a-88af-119a7ba350ad', '2e5f6adc-ede4-4ae8-8b00-b2671e88fc7b', 'e39161d0-dcb4-484d-ae0c-3dc95815f63d'} {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.150889] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1546.169863] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.170089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.170089] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.170324] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.170414] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.170524] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1546.170596] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.170667] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1546.255581] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.255804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.255804] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.255940] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.257115] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.257386] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1546.257465] env[65381]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65381) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1546.257540] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1546.257607] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1546.257684] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 1546.257756] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGH for action security_group_rules [ 1546.257832] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGH for action security_group_rules [ 1546.257900] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGH for action security_group_rules [ 1546.257964] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGH for action security_group_rules [ 1546.258053] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGH for action security_group_rules [ 1546.258159] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGH for action security_group_rules [ 1546.258218] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGH for action security_group_rules [ 1546.258257] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGH for action security_group_rules [ 1546.258294] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGH for action security_group_rules [ 1546.258357] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGH for action security_group_rules [ 1546.258415] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGH for action security_group_rules [ 1546.258475] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGH for action security_group_rules [ 1546.258534] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGH for action security_group_rules [ 1546.258594] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGH for action security_group_rules [ 1546.258654] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGH for action security_group_rules [ 1546.258714] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGH for action security_group_rules [ 1546.258774] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGH for action security_group_rules [ 1546.258833] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGH for action security_group_rules [ 1546.258893] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGH for action security_group_rules [ 1546.258952] env[65381]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGH for action security_group_rules [ 1546.259052] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.251686] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1549.252103] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1549.252103] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 with Priority: HIGH for action security_group_rules [ 1549.252103] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a58ced-f936-4d85-96d1-2772060a7aae with Priority: HIGH for action security_group_rules [ 1549.252290] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c with Priority: HIGH for action security_group_rules [ 1549.252290] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb with Priority: HIGH for action security_group_rules [ 1549.252396] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13ab4e4-01d1-4513-ab86-141d5851283d with Priority: HIGH for action security_group_rules [ 1549.252433] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f with Priority: HIGH for action security_group_rules [ 1549.252532] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 with Priority: HIGH for action security_group_rules [ 1549.252635] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 with Priority: HIGH for action security_group_rules [ 1549.252730] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b495a081-8211-4db6-af3d-10fc0b2f521c with Priority: HIGH for action security_group_rules [ 1549.252820] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48eacb50-df32-446c-947a-a00fbf576caa with Priority: HIGH for action security_group_rules [ 1549.252907] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61c2d48d-c321-4e23-999d-809958401c70 with Priority: HIGH for action security_group_rules [ 1549.252994] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 with Priority: HIGH for action security_group_rules [ 1549.253098] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274f904b-e458-4b4b-9611-3ae0669bc24b with Priority: HIGH for action security_group_rules [ 1549.253186] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd with Priority: HIGH for action security_group_rules [ 1549.253275] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGH for action security_group_rules [ 1549.253361] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 with Priority: HIGH for action security_group_rules [ 1549.253449] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37606f1e-5056-4e58-a1bc-c0149290eead with Priority: HIGH for action security_group_rules [ 1549.253534] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46372329-aee9-4feb-9469-adefbb727cb5 with Priority: HIGH for action security_group_rules [ 1549.253621] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e with Priority: HIGH for action security_group_rules [ 1549.253707] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf with Priority: HIGH for action security_group_rules [ 1549.254068] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.254204] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.254267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.254482] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.254568] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5417c42-09b8-4d6e-a6e5-4941c3e00ca9',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.255557] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39a58ced-f936-4d85-96d1-2772060a7aae taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.255674] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.255736] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.255905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.255980] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39a58ced-f936-4d85-96d1-2772060a7aae',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.256749] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.256849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.256915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.257066] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.257137] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9dd8321a-02cb-4cdb-814d-b0c5058cc03c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.259555] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.259662] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.259727] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.259872] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.259943] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('007dd7b5-b0ce-46da-9cc3-86f074d0bbdb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.260663] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d13ab4e4-01d1-4513-ab86-141d5851283d taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.260769] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.260852] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.260978] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.261061] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d13ab4e4-01d1-4513-ab86-141d5851283d',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.261717] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.261821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.261880] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.262048] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.262139] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b920740-c3e2-4b99-9809-c5e2dc5ba69f',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.262791] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.262905] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.262970] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.263111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.263179] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2f08ea40-f56b-4bd5-a0f9-e991cad65528',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.263831] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5deaafa-85eb-41da-90a6-8945218fb5f5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.263929] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.264068] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.264147] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.264210] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5deaafa-85eb-41da-90a6-8945218fb5f5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.264981] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b495a081-8211-4db6-af3d-10fc0b2f521c taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.265111] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.265155] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.265378] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.265378] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b495a081-8211-4db6-af3d-10fc0b2f521c',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.266021] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48eacb50-df32-446c-947a-a00fbf576caa taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.266144] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.266205] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.266327] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.266409] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48eacb50-df32-446c-947a-a00fbf576caa',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.267051] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-61c2d48d-c321-4e23-999d-809958401c70 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.267215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.267215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.267415] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.267453] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('61c2d48d-c321-4e23-999d-809958401c70',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.268211] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.268338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.268338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.268534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.268599] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5ab19d-0519-49e0-95a2-457ebf3b46a0',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.269279] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-274f904b-e458-4b4b-9611-3ae0669bc24b taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.269430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.269430] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.269775] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.269775] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('274f904b-e458-4b4b-9611-3ae0669bc24b',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.270328] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51eca9de-71e7-42ac-8af4-13f26cb274bd taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.270426] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.270479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.270971] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.270971] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51eca9de-71e7-42ac-8af4-13f26cb274bd',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.271345] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.271447] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.271568] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.271641] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.271715] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.272499] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0109d178-d310-4d94-9ce8-74560a55bfa3 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.272620] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.272691] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.272830] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.272968] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0109d178-d310-4d94-9ce8-74560a55bfa3',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.273552] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37606f1e-5056-4e58-a1bc-c0149290eead taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.274125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.274125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.274125] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.274125] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37606f1e-5056-4e58-a1bc-c0149290eead',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.274572] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46372329-aee9-4feb-9469-adefbb727cb5 taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.274693] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.274752] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.274877] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.274948] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46372329-aee9-4feb-9469-adefbb727cb5',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.275701] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40be60f5-b915-4038-8a92-b31ab9bbba3e taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.275801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.275878] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.276015] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.276117] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40be60f5-b915-4038-8a92-b31ab9bbba3e',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.277062] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.277183] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.277294] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.277459] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.277550] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e6956fc-e986-4223-b0b3-c4fabc7eb8cf',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.307036] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.307221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.307289] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.307454] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.309617] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.309733] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.333579] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.333845] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b920740-c3e2-4b99-9809-c5e2dc5ba69f is going to be deleted. [ 1549.334591] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.334803] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.354533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.354793] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39a58ced-f936-4d85-96d1-2772060a7aae is going to be deleted. [ 1549.399990] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.400340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.400340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.400472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.400540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.400754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b920740-c3e2-4b99-9809-c5e2dc5ba69f" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.401420] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.401611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.401611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.401780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.401860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.401938] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39a58ced-f936-4d85-96d1-2772060a7aae" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.795260] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.795586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.795586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.795780] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.795906] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.796022] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.796086] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.796229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.796314] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.796401] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.796486] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.863218] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.863427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.863427] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.863651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.865404] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.865572] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.866308] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.866412] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.867168] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.867267] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.868030] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.868198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.869242] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.869358] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.870029] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.870129] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.870790] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.870882] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.871566] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.871661] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.872547] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.872742] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.873861] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.873956] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.875375] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.875793] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.875887] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.877530] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.877924] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.878031] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.878660] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.879042] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.879153] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.884754] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.885163] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.885292] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40be60f5-b915-4038-8a92-b31ab9bbba3e is going to be deleted. [ 1549.886248] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.886460] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.887908] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.888027] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.888785] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.888883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.889798] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.890263] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.890372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.906369] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1549.906860] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.906985] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37606f1e-5056-4e58-a1bc-c0149290eead is going to be deleted. [ 1549.907922] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.908168] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.928477] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.928684] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9dd8321a-02cb-4cdb-814d-b0c5058cc03c is going to be deleted. [ 1549.929495] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.929712] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.947665] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.947914] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.957587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.957783] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48eacb50-df32-446c-947a-a00fbf576caa is going to be deleted. [ 1549.958645] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.958857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.974825] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.975035] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.995224] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.995458] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5417c42-09b8-4d6e-a6e5-4941c3e00ca9 is going to be deleted. [ 1549.996312] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.996531] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.009216] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.009534] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.023623] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.023799] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b495a081-8211-4db6-af3d-10fc0b2f521c is going to be deleted. [ 1550.024677] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.024913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.031244] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.031439] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.091213] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.091513] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46372329-aee9-4feb-9469-adefbb727cb5 is going to be deleted. [ 1550.092281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.092504] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.110935] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.111215] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.171264] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.171535] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.182846] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.183052] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 61c2d48d-c321-4e23-999d-809958401c70 is going to be deleted. [ 1550.183884] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.184116] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.210212] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.210431] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d13ab4e4-01d1-4513-ab86-141d5851283d is going to be deleted. [ 1550.211293] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.211512] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.245836] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.246075] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.252533] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.252944] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0109d178-d310-4d94-9ce8-74560a55bfa3 is going to be deleted. [ 1550.253625] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.253843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.285986] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.286177] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e6956fc-e986-4223-b0b3-c4fabc7eb8cf is going to be deleted. [ 1550.287060] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.287281] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.302130] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1550.314503] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.314697] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.336759] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.337034] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.361990] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.362255] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 274f904b-e458-4b4b-9611-3ae0669bc24b is going to be deleted. [ 1550.363096] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.363322] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.435381] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.435578] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2f08ea40-f56b-4bd5-a0f9-e991cad65528 is going to be deleted. [ 1550.436519] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.436800] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.453761] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.453966] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.479455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.479674] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5ab19d-0519-49e0-95a2-457ebf3b46a0 is going to be deleted. [ 1550.480611] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.480825] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.494631] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.494915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.565391] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.565655] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.585812] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.586110] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5deaafa-85eb-41da-90a6-8945218fb5f5 is going to be deleted. [ 1550.586958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.587184] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.588580] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.588707] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.653691] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.653934] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.667472] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.667682] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 007dd7b5-b0ce-46da-9cc3-86f074d0bbdb is going to be deleted. [ 1550.668619] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.668867] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.724507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.724734] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51eca9de-71e7-42ac-8af4-13f26cb274bd is going to be deleted. [ 1550.725558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.725806] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.725890] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.725949] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40be60f5-b915-4038-8a92-b31ab9bbba3e" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.726130] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.726287] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.726372] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.726479] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37606f1e-5056-4e58-a1bc-c0149290eead" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.727024] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.727189] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.727318] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.727455] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9dd8321a-02cb-4cdb-814d-b0c5058cc03c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.727593] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.727770] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.727843] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.727958] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48eacb50-df32-446c-947a-a00fbf576caa" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.728119] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.728243] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.728302] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.728413] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5417c42-09b8-4d6e-a6e5-4941c3e00ca9" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.728545] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.728681] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.728754] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.728869] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b495a081-8211-4db6-af3d-10fc0b2f521c" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.728992] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.729148] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.729225] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.729340] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46372329-aee9-4feb-9469-adefbb727cb5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.729467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.729604] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.729678] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.729793] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-61c2d48d-c321-4e23-999d-809958401c70" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.729918] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.730067] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.730141] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.730285] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d13ab4e4-01d1-4513-ab86-141d5851283d" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.730417] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.730558] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.730629] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.730740] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0109d178-d310-4d94-9ce8-74560a55bfa3" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.730861] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.730995] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.731085] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.731198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e6956fc-e986-4223-b0b3-c4fabc7eb8cf" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.731329] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.731467] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.731540] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.731651] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-274f904b-e458-4b4b-9611-3ae0669bc24b" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.731774] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.731909] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.731983] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.732109] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2f08ea40-f56b-4bd5-a0f9-e991cad65528" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.732233] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.732370] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.732437] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.732570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5ab19d-0519-49e0-95a2-457ebf3b46a0" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.768796] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.769023] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.769105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.769261] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.769353] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.769478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5deaafa-85eb-41da-90a6-8945218fb5f5" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.795882] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.796107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.796107] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.796296] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.796385] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.796503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-007dd7b5-b0ce-46da-9cc3-86f074d0bbdb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.804991] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb: rpc.has_security_group_logging(os_id): False [ 1550.834134] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.834355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.834355] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.834542] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.834627] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.834821] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51eca9de-71e7-42ac-8af4-13f26cb274bd" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.838186] env[65381]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1550.838711] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.838820] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.838903] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.839079] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.893390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.893719] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.893849] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.893911] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.894135] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.894220] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.894311] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1551.005109] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1551.005323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1551.005323] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1551.005463] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1551.005607] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1551.023282] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1553.037534] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1553.037973] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.255493] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1554.255856] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.256743] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.256743] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1564.258678] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.259146] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.260158] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.260593] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.261025] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.261416] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.262547] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.262907] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.319983] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock network-164 taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.320208] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.320331] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.320626] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.320879] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.321061] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.321160] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.321374] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.321544] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.321770] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1579.321883] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] NeedRegenerationException {{(pid=65381) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1579.321988] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] no value, waiting for create lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1579.322108] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] value creation lock acquired {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1579.322214] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] No value present for key: 'zone-id' {{(pid=65381) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1579.322315] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Calling creation function for not-yet-present value {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1579.322443] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1579.341798] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1579.341956] env[65381]: DEBUG dogpile.cache.region [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65381) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1579.342109] env[65381]: DEBUG dogpile.lock [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Released creation lock {{(pid=65381) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1579.342274] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "network-164" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.342576] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff taken with stack trace [, , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.342763] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.342889] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.343121] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.343252] env[65381]: DEBUG networking_nsxv3.api.rpc [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a0b75a-3e0d-4a93-baa3-13c4be0357ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1579.846054] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.846318] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.846456] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.846765] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.846912] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.847213] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.847372] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.847486] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.847708] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.847841] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.848134] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.848388] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.848612] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.848858] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.848998] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.849168] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Resource: SegmentPort with ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff is going to be updated. [ 1579.870479] env[65381]: DEBUG networking_nsxv3.common.locking [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1579.870734] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1579.870806] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1579.871027] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1579.871248] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1579.871483] env[65381]: DEBUG oslo_concurrency.lockutils [None req-01c95277-6d5c-4330-b4f1-201a07b8e0b1 None None] Releasing lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.549014] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5ba785d-4c7a-49c7-b5ff-48d0abca67a2 req-879df116-b2ba-47f3-98e7-735bd056cfe7 service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1580.549014] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5ba785d-4c7a-49c7-b5ff-48d0abca67a2 req-879df116-b2ba-47f3-98e7-735bd056cfe7 service nova] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1580.549014] env[65381]: INFO networking_nsxv3.common.synchronization [req-b5ba785d-4c7a-49c7-b5ff-48d0abca67a2 req-879df116-b2ba-47f3-98e7-735bd056cfe7 service nova] Enqueued Resource ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff with Priority: HIGHEST for action port [ 1580.549599] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_rules [ 1580.549599] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1580.549599] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff with Priority: HIGHEST for action port [ 1580.549866] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.550451] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.550538] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.550745] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.550830] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.551859] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.551859] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.552008] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.552050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.552203] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.552276] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.552338] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.552478] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.552553] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1580.552648] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1580.553795] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1580.553795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1580.553795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1580.553795] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1580.553795] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7a0b75a-3e0d-4a93-baa3-13c4be0357ff',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.055287] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1581.056373] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.056503] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.056840] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7a0b75a-3e0d-4a93-baa3-13c4be0357ff with status ACTIVE [ 1581.057017] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.057128] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.057190] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.057390] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.057507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.057643] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.057739] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.057801] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.057953] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.058044] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.058226] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.058319] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.058380] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.058528] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.058592] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.058676] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7a0b75a-3e0d-4a93-baa3-13c4be0357ff is going to be updated. [ 1581.079966] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1581.080231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1581.080231] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1581.080469] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1581.080603] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.080857] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7a0b75a-3e0d-4a93-baa3-13c4be0357ff" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1581.558250] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1582.060630] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.060915] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.060972] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.061221] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.061343] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.061472] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1582.096470] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1582.096735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1582.096735] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1582.096985] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1582.097229] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1582.107061] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1584.118578] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1584.118948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.118948] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.119192] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.119386] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1584.119507] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1584.119587] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1584.119761] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1584.119845] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.119933] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1584.120036] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1584.622930] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1585.125299] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb: rpc.has_security_group_logging(os_id): False [ 1585.146448] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.146704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.146704] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.146913] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.147011] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.147272] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.147374] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.147440] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.147586] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.147660] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.147746] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1585.231334] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1585.231570] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1585.231656] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1585.231881] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1585.232065] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1585.248071] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1585.551143] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1585.551374] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1587.263661] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1587.264198] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1590.552759] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1590.552759] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.553682] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1595.554126] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1597.290009] env[65381]: INFO networking_nsxv3.common.synchronization [req-11f39f71-dbcf-47c0-acf0-27897ddf8d23 req-80cdb197-50c2-43e9-aeb8-cb2a024442c3 tempest-ServerActionsTestOtherB-1410394615 tempest-ServerActionsTestOtherB-1410394615-project-member] Enqueued Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1597.290460] env[65381]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb with Priority: HIGHEST for action security_group_members [ 1597.290794] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb taken with stack trace [, , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.291352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.291352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.291352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.291352] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.291613] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.291613] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.291689] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.291767] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.291873] env[65381]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb',) {} {{(pid=65381) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1597.794855] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.795097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.795097] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.795352] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.795457] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.795666] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.795791] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.795883] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.795969] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.796050] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.796138] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb is going to be updated. [ 1597.823466] env[65381]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65381) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1597.823679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1597.823679] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1597.823866] env[65381]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1597.824017] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1597.832383] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: IN_PROGRESS for 2s [ 1599.844687] env[65381]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb in Status: SUCCESS [ 1599.845105] env[65381]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb deletion is rescheduled due to dependency. [ 1599.845105] env[65381]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7023f1a-4e65-47cd-9e69-b3a1e4c5fbfb" {{(pid=65381) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1602.292121] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1602.292551] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1607.293405] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1607.293772] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1612.294869] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1612.295334] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1617.296481] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1617.296841] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1622.297861] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1622.297861] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1627.299291] env[65381]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1627.299699] env[65381]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0